2024-09-16T16:32:35.809 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:32:35.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:32:35.905 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench} email: null first_in_suite: false job_id: '7907370' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkAruWnHPeuPtXrCB60FyOu4Lzf2BDkxbVjj3D9nPJx4ju9tCgydEtAIlr1kFW3JrUyLnmREL9cB30ZKhr7iMc= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCUjRjabzKSC98JmCCrC/Hk1HL7IUhnwnNb8TEvE8tUjA1B6hmcZGpUlefQD3uJkZzm5/saVt1dntD3rHDtvbA= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:32:35.905 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:32:35.906 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:32:35.906 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:32:35.907 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:32:35.928 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:32:35.928 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:32:35.928 INFO:teuthology.packaging:ref: None 2024-09-16T16:32:35.928 INFO:teuthology.packaging:tag: None 2024-09-16T16:32:35.928 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:32:35.928 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:32:35.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:32:36.066 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:32:36.068 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:32:36.075 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:32:36.075 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:32:36.082 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:32:36.097 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:32:36.105 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:32:36.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:50.750084', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkAruWnHPeuPtXrCB60FyOu4Lzf2BDkxbVjj3D9nPJx4ju9tCgydEtAIlr1kFW3JrUyLnmREL9cB30ZKhr7iMc='} 2024-09-16T16:32:36.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:50.751523', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCUjRjabzKSC98JmCCrC/Hk1HL7IUhnwnNb8TEvE8tUjA1B6hmcZGpUlefQD3uJkZzm5/saVt1dntD3rHDtvbA='} 2024-09-16T16:32:36.142 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:32:36.148 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T16:32:36.148 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T16:32:36.148 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:32:36.195 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f24defe3be0>, signals=[15]) 2024-09-16T16:32:36.195 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:32:36.201 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:32:36.201 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T16:32:36.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:36.278 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T16:32:36.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:36.393 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:32:36.400 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-16T16:32:36.418 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-16T16:32:36.419 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-16T16:32:36.476 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-16T16:32:36.476 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-16T16:32:36.476 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:36.478 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-16T16:32:36.497 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-16T16:32:36.515 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-16T16:32:36.516 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:36.574 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:36.575 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:36.575 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-16T16:32:36.597 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:32:36.606 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:32:36.611 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:32:36.611 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:36.614 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:36.630 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:32:36.637 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:32:36.637 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:36.671 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:36.706 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:32:36.760 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:32:36.775 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:32:36.775 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:32:36.776 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:36.776 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:36.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:36.793 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-16T16:32:36.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:36.794 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-16T16:32:36.851 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:36.851 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-16T16:32:36.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-16T16:32:36.852 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:36.852 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-16T16:32:36.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-16T16:32:39.133 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T16:32:41.684 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-16T16:32:43.385 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-16T16:32:46.967 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 20 MB 00:06 2024-09-16T16:32:48.294 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-16T16:32:49.778 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-16T16:32:50.908 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-16T16:32:51.392 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-16T16:32:52.993 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-16T16:32:54.771 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-16T16:32:56.297 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T16:32:58.312 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:32:58.312 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:32:58.395 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:32:58.406 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:32:58.407 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:32:58.408 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-16T16:32:58.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:32:58.408 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-16T16:32:58.408 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-16T16:32:58.408 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:32:58.632 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 232 kB/s | 23 kB 00:00 2024-09-16T16:32:59.040 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-16T16:32:59.482 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-16T16:32:59.958 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-16T16:32:59.958 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:32:59.958 INFO:teuthology.orchestra.run.smithi103.stdout:Total 51 MB/s | 79 MB 00:01 2024-09-16T16:33:00.235 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-16T16:33:00.639 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:33:01.000 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:33:01.000 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:33:01.958 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:33:01.959 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:33:02.259 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:33:02.259 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:33:02.354 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:33:02.366 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-16T16:33:02.367 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:33:02.368 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-16T16:33:02.368 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-16T16:33:02.368 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:33:02.795 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 69 kB/s | 23 kB 00:00 2024-09-16T16:33:04.465 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:33:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:08.099 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:08.229 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:11.586 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-16T16:33:12.614 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.9 MB/s | 29 MB 00:09 2024-09-16T16:33:13.040 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:13.096 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:17.947 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:19.244 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 955 kB/s | 16 MB 00:16 2024-09-16T16:33:19.244 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:33:19.244 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.7 MB/s | 79 MB 00:16 2024-09-16T16:33:19.923 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:33:20.287 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:33:20.287 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:33:21.289 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:33:21.289 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:33:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:33:24.411 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:24.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:27.293 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:27.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:32.244 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:32.284 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:37.127 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:57.686 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:57.686 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:33:57.686 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:33:57.687 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:33:58.021 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:58.108 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:58.119 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:58.120 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:33:58.120 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:33:58.120 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:33:58.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:33:58.120 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:33:58.120 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:33:58.179 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:33:58.179 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:33:58.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-16T16:33:58.211 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:33:58.212 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:33:58.213 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:33:58.214 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:33:58.214 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:33:58.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:33:58.848 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-16T16:34:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:34:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-16T16:34:00.201 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-16T16:34:00.216 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.af62iDWjGu 2024-09-16T16:34:00.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.af62iDWjGu 2024-09-16T16:34:00.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.af62iDWjGu 2024-09-16T16:34:00.427 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.af62iDWjGu is 6KB 2024-09-16T16:34:00.448 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.af62iDWjGu 2024-09-16T16:34:00.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:34:00.525 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:34:00.525 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:34:00.525 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:34:00.525 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:34:00.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:34:00.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-16T16:34:15.078 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:15.118 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:15.485 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:15.485 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:34:15.485 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:15.485 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:34:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:34:16.682 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:16.781 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.781 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:16.782 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:34:16.782 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:34:16.782 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:34:16.782 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T16:34:16.782 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:34:16.782 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:16.842 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:16.842 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:16.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-16T16:34:16.882 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-16T16:34:16.883 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:34:16.884 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:34:16.885 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:34:16.885 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:34:16.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:34:17.583 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-16T16:34:18.907 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:34:18.951 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-16T16:34:18.953 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-16T16:34:18.968 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.T4LC19eL7a 2024-09-16T16:34:18.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.T4LC19eL7a 2024-09-16T16:34:19.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.T4LC19eL7a 2024-09-16T16:34:19.172 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.T4LC19eL7a is 6KB 2024-09-16T16:34:19.193 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.T4LC19eL7a 2024-09-16T16:34:19.208 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:34:19.270 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:34:19.271 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:34:19.271 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:34:19.271 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:34:19.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:34:19.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-16T16:34:30.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:34:30.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:34:30.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:49.424 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T16:34:49.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-16T16:34:49.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:05.153 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-16T16:35:14.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:35:14.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:49.461 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:35:58.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-16T16:35:58.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:59.790 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-16T16:36:00.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-16T16:36:00.377 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:36:00.378 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-16T16:36:00.394 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:36:00.395 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:36:00.395 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:36:00.395 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:36:01.396 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T16:36:01.396 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:36:01.508 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-16T16:36:01.530 DEBUG:teuthology.parallel:result is None 2024-09-16T16:36:14.164 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:36:26.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:36:26.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:36:26.655 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-16T16:36:26.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:36:26.980 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:36:26.980 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-16T16:36:26.998 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:36:26.998 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:36:26.998 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:36:26.998 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:36:27.999 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:36:28.000 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:36:28.078 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-16T16:36:28.103 DEBUG:teuthology.parallel:result is None 2024-09-16T16:36:28.103 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:36:28.114 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:36:28.115 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:36:28.117 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:36:28.140 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:36:28.147 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:36:28.158 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:36:28.158 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:36:28.176 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:36:28.269 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:36:28.278 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:36:28.278 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:36:28.281 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:36:28.312 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:28.323 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:28.325 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:28.336 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:28.338 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:36:28.345 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:36:28.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:36:28.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:36:28.392 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:36:28.407 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:36:28.407 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:36:28.424 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:36:28.450 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:28.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:28.568 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:28.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:28.694 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:36:28.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:36:28.759 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:28.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:28.855 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:28.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:28.984 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:36:28.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:36:29.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-16T16:36:29.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-16T16:36:29.099 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:36:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:36:29.591 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:36:29.602 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:36:29.602 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:36:29.620 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:36:29.635 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:36:29.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-16T16:36:29.682 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-16T16:36:29.684 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-16T16:36:29.746 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-16T16:36:29.748 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:36:29.748 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-16T16:36:29.775 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-16T16:36:29.775 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-16T16:36:29.811 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-16T16:36:29.811 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:36:29.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:36:29.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:36:29.843 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:36:29.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:36:29.882 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:36:29.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:36:29.917 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:36:29.952 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:36:29.973 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:36:30.008 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:36:30.010 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:40:53.311 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-16T16:40:53.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:40:53.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:53.392 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-16T16:40:53.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-16T16:40:53.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-16T16:40:53.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:53.555 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-16T16:40:53.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-16T16:40:53.637 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:40:53.649 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:40:53.649 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:53.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:53.652 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:53.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:53.678 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:53.693 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:53.708 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:53.717 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-16T16:40:53.722 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:53.728 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-16T16:40:53.743 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:53.746 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-16T16:40:53.757 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:53.757 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-16T16:40:53.771 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:53.785 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:53.813 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:53.816 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:53.816 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-16T16:40:53.816 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.816 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.816 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.817 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.840 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:53.843 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:53.843 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-16T16:40:53.843 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.844 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.844 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.844 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:53.845 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:40:53.853 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:40:53.853 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:40:53.853 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:40:53.853 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:40:53.859 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:40:53.859 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:40:53.860 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:53.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:53.862 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:53.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:54.007 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:54.007 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:54.011 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:54.011 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:54.340 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:54.340 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:40:54.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:54.343 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:54.343 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:40:54.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:54.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:54.367 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:54.370 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:54.370 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:54.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:54.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:54.509 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:54.511 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:54.573 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-16T16:40:54.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-16T16:40:54.575 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-16T16:40:54.577 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-16T16:40:54.806 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-16T16:40:54.811 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-16T16:40:54.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-09-16T16:40:54.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw 2024-09-16T16:40:55.882 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 116 kB/s | 88 kB 00:00 2024-09-16T16:40:55.938 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 109 kB/s | 88 kB 00:00 2024-09-16T16:40:56.641 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 33 kB/s | 24 kB 00:00 2024-09-16T16:40:56.688 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 34 kB/s | 24 kB 00:00 2024-09-16T16:40:57.367 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 3.0 kB/s | 2.1 kB 00:00 2024-09-16T16:40:57.422 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 3.0 kB/s | 2.1 kB 00:00 2024-09-16T16:40:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-16T16:40:59.747 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-16T16:41:01.184 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-16T16:41:02.232 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-16T16:41:07.599 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-16T16:41:08.202 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-16T16:41:09.059 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-16T16:41:10.172 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-16T16:41:10.503 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-16T16:41:12.073 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-16T16:41:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 3.4 kB/s | 1.7 kB 00:00 2024-09-16T16:41:17.562 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T16:41:18.404 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:41:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:18.417 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:41:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:18.417 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:41:18.418 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:41:18.419 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:18.420 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:Install 31 Packages 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 60 M 2024-09-16T16:41:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:41:19.922 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:41:19.934 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:41:19.934 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:41:19.934 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:41:19.934 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:41:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:41:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:41:19.937 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:41:19.938 INFO:teuthology.orchestra.run.smithi142.stdout:Install 31 Packages 2024-09-16T16:41:19.938 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-09-16T16:41:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:41:19.938 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 60 M 2024-09-16T16:41:19.938 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:41:21.637 INFO:teuthology.orchestra.run.smithi103.stdout:(1/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 3.4 MB/s | 10 MB 00:03 2024-09-16T16:41:21.737 INFO:teuthology.orchestra.run.smithi103.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 252 kB/s | 25 kB 00:00 2024-09-16T16:41:22.004 INFO:teuthology.orchestra.run.smithi103.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 3.0 MB/s | 809 kB 00:00 2024-09-16T16:41:22.188 INFO:teuthology.orchestra.run.smithi103.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 3.0 MB/s | 558 kB 00:00 2024-09-16T16:41:23.672 INFO:teuthology.orchestra.run.smithi103.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 3.6 MB/s | 5.4 MB 00:01 2024-09-16T16:41:23.772 INFO:teuthology.orchestra.run.smithi103.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 452 kB/s | 45 kB 00:00 2024-09-16T16:41:23.872 INFO:teuthology.orchestra.run.smithi103.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.4 MB/s | 143 kB 00:00 2024-09-16T16:41:23.972 INFO:teuthology.orchestra.run.smithi103.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.6 MB/s | 160 kB 00:00 2024-09-16T16:41:24.889 INFO:teuthology.orchestra.run.smithi103.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 344 kB/s | 315 kB 00:00 2024-09-16T16:41:25.148 INFO:teuthology.orchestra.run.smithi103.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.1 MB/s | 302 kB 00:00 2024-09-16T16:41:25.248 INFO:teuthology.orchestra.run.smithi103.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 995 kB/s | 99 kB 00:00 2024-09-16T16:41:25.357 INFO:teuthology.orchestra.run.smithi103.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 986 kB/s | 107 kB 00:00 2024-09-16T16:41:25.424 INFO:teuthology.orchestra.run.smithi103.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-16T16:41:25.466 INFO:teuthology.orchestra.run.smithi103.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-16T16:41:25.508 INFO:teuthology.orchestra.run.smithi103.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T16:41:25.609 INFO:teuthology.orchestra.run.smithi103.stdout:(16/33): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-16T16:41:25.675 INFO:teuthology.orchestra.run.smithi103.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-16T16:41:25.717 INFO:teuthology.orchestra.run.smithi103.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-16T16:41:25.784 INFO:teuthology.orchestra.run.smithi103.stdout:(19/33): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-16T16:41:25.826 INFO:teuthology.orchestra.run.smithi103.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 863 kB/s | 36 kB 00:00 2024-09-16T16:41:25.868 INFO:teuthology.orchestra.run.smithi103.stdout:(21/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T16:41:25.919 INFO:teuthology.orchestra.run.smithi103.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-16T16:41:26.061 INFO:teuthology.orchestra.run.smithi103.stdout:(23/33): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-16T16:41:26.086 INFO:teuthology.orchestra.run.smithi103.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T16:41:26.111 INFO:teuthology.orchestra.run.smithi103.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T16:41:26.136 INFO:teuthology.orchestra.run.smithi103.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T16:41:26.178 INFO:teuthology.orchestra.run.smithi103.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-16T16:41:26.204 INFO:teuthology.orchestra.run.smithi103.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.4 MB/s | 191 kB 00:00 2024-09-16T16:41:26.271 INFO:teuthology.orchestra.run.smithi103.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-16T16:41:26.688 INFO:teuthology.orchestra.run.smithi103.stdout:(30/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x8 768 kB/s | 6.1 MB 00:08 2024-09-16T16:41:28.613 INFO:teuthology.orchestra.run.smithi103.stdout:(31/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 2.0 MB/s | 20 MB 00:10 2024-09-16T16:41:29.063 INFO:teuthology.orchestra.run.smithi103.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 1.6 MB/s | 3.8 MB 00:02 2024-09-16T16:41:29.371 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 665 kB/s | 6.1 MB 00:09 2024-09-16T16:41:29.439 INFO:teuthology.orchestra.run.smithi103.stdout:(33/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 1.1 MB/s | 3.5 MB 00:03 2024-09-16T16:41:29.443 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:41:29.443 INFO:teuthology.orchestra.run.smithi103.stdout:Total 5.5 MB/s | 60 MB 00:11 2024-09-16T16:41:29.479 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 232 kB/s | 25 kB 00:00 2024-09-16T16:41:29.555 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:41:29.593 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:41:29.594 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:41:30.246 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:41:30.246 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:41:30.772 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 626 kB/s | 809 kB 00:01 2024-09-16T16:41:31.655 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 632 kB/s | 558 kB 00:00 2024-09-16T16:41:31.750 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:41:32.254 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:41:32.333 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:32.425 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:41:32.551 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:32.648 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:41:32.681 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:41:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:41:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:41:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:41:33.015 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:41:33.046 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:41:33.089 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:41:33.132 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:41:33.162 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:41:33.241 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:41:33.267 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:41:33.356 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:41:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:41:33.512 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:41:33.554 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:41:33.580 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 1.5 MB/s | 20 MB 00:13 2024-09-16T16:41:33.602 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:41:33.641 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:41:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:41:33.707 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:41:34.079 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:41:34.122 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 83 kB/s | 45 kB 00:00 2024-09-16T16:41:34.141 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:34.232 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:34.263 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:41:34.308 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:41:34.380 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 554 kB/s | 143 kB 00:00 2024-09-16T16:41:34.897 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:41:34.928 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:34.955 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 278 kB/s | 160 kB 00:00 2024-09-16T16:41:34.991 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:35.069 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:41:35.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:41:35.589 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 498 kB/s | 315 kB 00:00 2024-09-16T16:41:36.673 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 279 kB/s | 302 kB 00:01 2024-09-16T16:41:37.015 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 291 kB/s | 99 kB 00:00 2024-09-16T16:41:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 917 kB/s | 107 kB 00:00 2024-09-16T16:41:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-16T16:41:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-16T16:41:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-16T16:41:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-16T16:41:37.383 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-09-16T16:41:37.417 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-16T16:41:37.458 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-16T16:41:37.492 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 1.1 MB/s | 36 kB 00:00 2024-09-16T16:41:37.526 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-16T16:41:37.576 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-16T16:41:37.588 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:37.627 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:37.768 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-16T16:41:37.785 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-16T16:41:37.810 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T16:41:37.835 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T16:41:37.886 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-16T16:41:37.911 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-16T16:41:38.003 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-16T16:41:38.346 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:41:38.397 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:38.495 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:41:38.495 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:41:38.496 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:41:38.496 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:38.532 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:42.370 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 515 kB/s | 5.4 MB 00:10 2024-09-16T16:41:43.437 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 653 kB/s | 3.5 MB 00:05 2024-09-16T16:41:46.878 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 862 kB/s | 3.8 MB 00:04 2024-09-16T16:41:48.876 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:48.876 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-16T16:41:48.877 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:49.999 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:50.023 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:41:50.024 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:41:50.024 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:41:50.024 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:50.024 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:41:50.024 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:50.025 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:50.118 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:41:50.118 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:41:51.415 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:41:51.416 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:41:51.417 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:41:51.417 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:41:51.417 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:41:51.417 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:41:51.418 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:41:52.111 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 332 kB/s | 10 MB 00:32 2024-09-16T16:41:52.115 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:41:52.115 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.9 MB/s | 60 MB 00:32 2024-09-16T16:41:52.233 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:41:52.270 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:41:52.270 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.384 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:41:52.385 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:41:52.386 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:41:52.387 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:52.387 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:41:52.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test 2024-09-16T16:41:52.950 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:41:52.951 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:41:53.327 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:38 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:41:53.463 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:41:53.464 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:53.464 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:41:53.464 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:53.464 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:41:53.465 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:41:53.466 INFO:teuthology.orchestra.run.smithi103.stdout:Install 9 Packages 2024-09-16T16:41:53.466 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:41:53.466 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 87 M 2024-09-16T16:41:53.466 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 797 M 2024-09-16T16:41:53.466 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:41:53.941 INFO:teuthology.orchestra.run.smithi103.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 546 kB/s | 94 kB 00:00 2024-09-16T16:41:54.091 INFO:teuthology.orchestra.run.smithi103.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.4 MB/s | 513 kB 00:00 2024-09-16T16:41:54.133 INFO:teuthology.orchestra.run.smithi103.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-16T16:41:54.334 INFO:teuthology.orchestra.run.smithi103.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-16T16:41:54.442 INFO:teuthology.orchestra.run.smithi103.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-16T16:41:54.494 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:41:54.501 INFO:teuthology.orchestra.run.smithi103.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-16T16:41:54.560 INFO:teuthology.orchestra.run.smithi103.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-16T16:41:54.677 INFO:teuthology.orchestra.run.smithi103.stdout:(8/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 193 kB/s | 175 kB 00:00 2024-09-16T16:41:54.997 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:41:55.088 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:41:55.277 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:41:55.306 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:55.369 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:41:55.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:41:55.444 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:41:55.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:41:55.492 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:41:55.512 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:41:55.719 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:41:55.750 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:41:55.785 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:41:55.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:41:55.857 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:41:55.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:41:55.963 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:41:56.042 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:41:56.092 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:41:56.193 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:41:56.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:41:56.279 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:41:56.319 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:41:56.348 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:41:56.385 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:41:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:41:56.805 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:56.896 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:41:56.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:41:56.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:41:57.542 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:41:57.573 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:41:57.723 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:41:57.759 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:42:00.257 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:00.289 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:01.010 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:01.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:01.143 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:42:01.143 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:42:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-16T16:42:10.989 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:12.049 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:42:13.443 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:42:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:42:13.445 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:42:13.446 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:13.446 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:42:13.446 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:42:14.543 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:14.543 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:42:14.544 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:42:14.545 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:42:14.546 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:42:14.547 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:42:14.547 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:14.547 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:42:14.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-09-16T16:42:15.490 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:58 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:42:15.622 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:42:15.623 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:42:15.623 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:42:15.624 INFO:teuthology.orchestra.run.smithi142.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout:Install 9 Packages 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:42:15.625 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 87 M 2024-09-16T16:42:15.626 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 797 M 2024-09-16T16:42:15.626 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:42:16.299 INFO:teuthology.orchestra.run.smithi142.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 655 kB/s | 94 kB 00:00 2024-09-16T16:42:16.432 INFO:teuthology.orchestra.run.smithi142.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.8 MB/s | 513 kB 00:00 2024-09-16T16:42:16.474 INFO:teuthology.orchestra.run.smithi142.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-16T16:42:16.550 INFO:teuthology.orchestra.run.smithi142.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-16T16:42:16.608 INFO:teuthology.orchestra.run.smithi142.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-16T16:42:16.658 INFO:teuthology.orchestra.run.smithi142.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T16:42:16.709 INFO:teuthology.orchestra.run.smithi142.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-09-16T16:42:16.925 INFO:teuthology.orchestra.run.smithi142.stdout:(8/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 227 kB/s | 175 kB 00:00 2024-09-16T16:42:54.280 INFO:teuthology.orchestra.run.smithi103.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 1.4 MB/s | 85 MB 01:00 2024-09-16T16:42:54.283 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:54.283 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.4 MB/s | 87 MB 01:00 2024-09-16T16:42:54.361 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:42:55.011 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:42:55.011 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:42:55.897 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:42:55.968 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:42:56.024 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:42:56.076 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:42:56.102 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:42:56.142 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:42:56.166 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:42:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:42:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:42:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:07.600 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:43:14.003 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:14.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:43:14.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:43:14.004 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:43:14.411 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:43:14.412 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:43:14.413 INFO:teuthology.orchestra.run.smithi103.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:43:14.413 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:43:14.413 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:43:14.786 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph 2024-09-16T16:43:15.351 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:02:00 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:43:15.487 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:43:15.489 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:43:15.489 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:43:15.490 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:43:15.491 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:43:15.492 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout:Install 37 Packages 2024-09-16T16:43:15.493 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:43:15.494 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 84 M 2024-09-16T16:43:15.494 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 897 M 2024-09-16T16:43:15.494 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:43:16.124 INFO:teuthology.orchestra.run.smithi103.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-09-16T16:43:17.233 INFO:teuthology.orchestra.run.smithi103.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.1 MB/s | 1.6 MB 00:01 2024-09-16T16:43:17.941 INFO:teuthology.orchestra.run.smithi103.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.0 MB/s | 2.2 MB 00:02 2024-09-16T16:43:18.258 INFO:teuthology.orchestra.run.smithi103.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 919 kB/s | 291 kB 00:00 2024-09-16T16:43:18.400 INFO:teuthology.orchestra.run.smithi103.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-16T16:43:18.492 INFO:teuthology.orchestra.run.smithi103.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-16T16:43:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T16:43:18.576 INFO:teuthology.orchestra.run.smithi103.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-16T16:43:18.626 INFO:teuthology.orchestra.run.smithi103.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-16T16:43:18.677 INFO:teuthology.orchestra.run.smithi103.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T16:43:18.852 INFO:teuthology.orchestra.run.smithi103.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-16T16:43:18.910 INFO:teuthology.orchestra.run.smithi103.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-16T16:43:18.961 INFO:teuthology.orchestra.run.smithi103.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 695 kB/s | 35 kB 00:00 2024-09-16T16:43:19.011 INFO:teuthology.orchestra.run.smithi103.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T16:43:19.078 INFO:teuthology.orchestra.run.smithi103.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 766 kB/s | 51 kB 00:00 2024-09-16T16:43:19.128 INFO:teuthology.orchestra.run.smithi103.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-16T16:43:19.662 INFO:teuthology.orchestra.run.smithi103.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-16T16:43:19.721 INFO:teuthology.orchestra.run.smithi103.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-16T16:43:19.746 INFO:teuthology.orchestra.run.smithi103.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T16:43:19.779 INFO:teuthology.orchestra.run.smithi103.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-16T16:43:19.821 INFO:teuthology.orchestra.run.smithi103.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 8.4 MB/s | 358 kB 00:00 2024-09-16T16:43:19.847 INFO:teuthology.orchestra.run.smithi103.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 427 kB/s | 11 kB 00:00 2024-09-16T16:43:19.872 INFO:teuthology.orchestra.run.smithi103.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-16T16:43:19.898 INFO:teuthology.orchestra.run.smithi103.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 913 kB/s | 23 kB 00:00 2024-09-16T16:43:19.923 INFO:teuthology.orchestra.run.smithi103.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 782 kB/s | 19 kB 00:00 2024-09-16T16:43:19.948 INFO:teuthology.orchestra.run.smithi103.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 784 kB/s | 20 kB 00:00 2024-09-16T16:43:19.974 INFO:teuthology.orchestra.run.smithi103.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-16T16:43:20.007 INFO:teuthology.orchestra.run.smithi103.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 2.3 MB/s | 79 kB 00:00 2024-09-16T16:43:20.049 INFO:teuthology.orchestra.run.smithi103.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-16T16:43:20.074 INFO:teuthology.orchestra.run.smithi103.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 662 kB/s | 16 kB 00:00 2024-09-16T16:43:20.108 INFO:teuthology.orchestra.run.smithi103.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-16T16:43:20.133 INFO:teuthology.orchestra.run.smithi103.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T16:43:20.176 INFO:teuthology.orchestra.run.smithi103.stdout:(33/37): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-16T16:43:20.226 INFO:teuthology.orchestra.run.smithi103.stdout:(34/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2024-09-16T16:43:20.251 INFO:teuthology.orchestra.run.smithi103.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-16T16:43:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:(36/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 955 kB/s | 5.1 MB 00:05 2024-09-16T16:43:51.254 INFO:teuthology.orchestra.run.smithi142.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 911 kB/s | 85 MB 01:35 2024-09-16T16:43:51.257 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:51.257 INFO:teuthology.orchestra.run.smithi142.stdout:Total 932 kB/s | 87 MB 01:35 2024-09-16T16:43:51.330 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:43:51.354 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:43:51.354 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:43:51.832 INFO:teuthology.orchestra.run.smithi103.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.0 MB/s | 70 MB 00:34 2024-09-16T16:43:51.835 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:51.835 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.3 MB/s | 84 MB 00:36 2024-09-16T16:43:51.972 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:43:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:43:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:43:52.013 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:43:52.013 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:43:52.812 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:43:52.813 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:43:52.866 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:43:52.946 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:43:53.003 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:43:53.058 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:43:53.085 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:43:53.116 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:53.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:53.213 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:53.258 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:43:53.284 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:54.461 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:43:54.526 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:43:54.568 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:43:54.603 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:43:54.675 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:43:54.710 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:43:54.743 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:43:54.835 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:43:54.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:43:54.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:43:55.023 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:43:55.053 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:43:55.087 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:43:55.120 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:43:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:43:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:43:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:43:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:43:55.311 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:43:55.385 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:43:55.547 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:43:55.637 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:43:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:43:55.728 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:43:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:43:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:43:56.036 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:43:56.082 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:43:56.161 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:43:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:43:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:43:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:43:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:43:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:43:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:43:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:43:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:43:56.686 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:43:56.686 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:43:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:07.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:07.356 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:07.356 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:07.356 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:44:07.356 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:07.357 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:07.357 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:07.912 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:07.935 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:08.179 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:08.202 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:08.203 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:08.203 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:44:08.203 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:08.203 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:08.203 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:08.259 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:44:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:44:10.375 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:44:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:44:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:44:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:44:10.376 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:44:10.861 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:44:10.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:44:10.861 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:44:10.862 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:44:11.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-09-16T16:44:11.775 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:54 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:11.917 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:44:11.920 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections 2024-09-16T16:44:11.921 INFO:teuthology.orchestra.run.smithi142.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:44:11.922 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout:Install 37 Packages 2024-09-16T16:44:11.923 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:44:11.924 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 84 M 2024-09-16T16:44:11.924 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 897 M 2024-09-16T16:44:11.924 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:44:12.789 INFO:teuthology.orchestra.run.smithi142.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-16T16:44:13.697 INFO:teuthology.orchestra.run.smithi142.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.3 MB/s | 1.6 MB 00:01 2024-09-16T16:44:14.048 INFO:teuthology.orchestra.run.smithi142.stdout:(3/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 4.1 MB/s | 5.1 MB 00:01 2024-09-16T16:44:14.323 INFO:teuthology.orchestra.run.smithi142.stdout:(4/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.2 MB/s | 2.2 MB 00:01 2024-09-16T16:44:14.456 INFO:teuthology.orchestra.run.smithi142.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-16T16:44:14.548 INFO:teuthology.orchestra.run.smithi142.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-16T16:44:14.590 INFO:teuthology.orchestra.run.smithi142.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T16:44:14.641 INFO:teuthology.orchestra.run.smithi142.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-16T16:44:14.683 INFO:teuthology.orchestra.run.smithi142.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-16T16:44:14.725 INFO:teuthology.orchestra.run.smithi142.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.1 MB/s | 215 kB 00:00 2024-09-16T16:44:14.750 INFO:teuthology.orchestra.run.smithi142.stdout:(11/37): ceph-mgr-modules-core-19.3.0-4879.g81f 414 kB/s | 291 kB 00:00 2024-09-16T16:44:15.249 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:15.249 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:44:15.249 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:44:15.249 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:44:15.250 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:44:15.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:44:15.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:44:15.275 INFO:teuthology.orchestra.run.smithi142.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 343 kB/s | 188 kB 00:00 2024-09-16T16:44:15.300 INFO:teuthology.orchestra.run.smithi142.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 313 kB/s | 172 kB 00:00 2024-09-16T16:44:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-16T16:44:15.419 INFO:teuthology.orchestra.run.smithi142.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 654 kB/s | 77 kB 00:00 2024-09-16T16:44:15.502 INFO:teuthology.orchestra.run.smithi142.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 434 kB/s | 51 kB 00:00 2024-09-16T16:44:15.527 INFO:teuthology.orchestra.run.smithi142.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 387 kB/s | 42 kB 00:00 2024-09-16T16:44:15.585 INFO:teuthology.orchestra.run.smithi142.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T16:44:15.619 INFO:teuthology.orchestra.run.smithi142.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-09-16T16:44:15.652 INFO:teuthology.orchestra.run.smithi142.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-16T16:44:15.720 INFO:teuthology.orchestra.run.smithi142.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-09-16T16:44:15.745 INFO:teuthology.orchestra.run.smithi142.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 434 kB/s | 11 kB 00:00 2024-09-16T16:44:15.770 INFO:teuthology.orchestra.run.smithi142.stdout:(23/37): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-16T16:44:15.796 INFO:teuthology.orchestra.run.smithi142.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-16T16:44:15.829 INFO:teuthology.orchestra.run.smithi142.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 742 kB/s | 19 kB 00:00 2024-09-16T16:44:15.855 INFO:teuthology.orchestra.run.smithi142.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 854 kB/s | 20 kB 00:00 2024-09-16T16:44:15.880 INFO:teuthology.orchestra.run.smithi142.stdout:(27/37): python3-jaraco-collections-3.0.0-8.el9 212 kB/s | 23 kB 00:00 2024-09-16T16:44:15.905 INFO:teuthology.orchestra.run.smithi142.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-16T16:44:15.930 INFO:teuthology.orchestra.run.smithi142.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T16:44:15.956 INFO:teuthology.orchestra.run.smithi142.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 656 kB/s | 16 kB 00:00 2024-09-16T16:44:15.989 INFO:teuthology.orchestra.run.smithi142.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T16:44:16.015 INFO:teuthology.orchestra.run.smithi142.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-16T16:44:16.040 INFO:teuthology.orchestra.run.smithi142.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-16T16:44:16.065 INFO:teuthology.orchestra.run.smithi142.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:44:16.090 INFO:teuthology.orchestra.run.smithi142.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-16T16:44:16.116 INFO:teuthology.orchestra.run.smithi142.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T16:44:16.252 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:44:16.252 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:16.252 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:44:16.253 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:44:16.254 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:16.546 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base 2024-09-16T16:44:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:02 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:17.194 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:17.236 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:44:17.237 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:17.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install cephadm 2024-09-16T16:44:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:02 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:18.002 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 785 k 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 791 k 2024-09-16T16:44:18.003 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:44:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 839 kB/s | 785 kB 00:00 2024-09-16T16:44:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:Total 838 kB/s | 785 kB 00:00 2024-09-16T16:44:18.940 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:44:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:44:18.946 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:44:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:44:18.952 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:44:19.027 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:44:19.477 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:19.951 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:20.211 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:44:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:20.211 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:20.212 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:20.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:44:21.008 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:06 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:21.143 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:44:21.144 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:44:21.145 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 158 k 2024-09-16T16:44:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 644 k 2024-09-16T16:44:21.145 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:44:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 132 kB/s | 158 kB 00:01 2024-09-16T16:44:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:Total 132 kB/s | 158 kB 00:01 2024-09-16T16:44:22.339 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:44:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:44:22.351 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:44:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:44:22.412 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:44:22.557 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:44:22.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:22.647 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:22.647 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:44:22.647 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:23.564 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:23.565 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:44:23.565 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:23.565 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:23.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr 2024-09-16T16:44:24.376 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:09 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:24.470 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:24.513 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:24.514 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:44:24.514 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:24.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:44:25.154 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:10 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:25.288 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:44:25.289 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:44:25.290 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:44:25.291 INFO:teuthology.orchestra.run.smithi103.stdout:Install 11 Packages 2024-09-16T16:44:25.291 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:25.291 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 18 M 2024-09-16T16:44:25.291 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 155 M 2024-09-16T16:44:25.291 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:44:26.692 INFO:teuthology.orchestra.run.smithi103.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 82 kB/s | 34 kB 00:00 2024-09-16T16:44:26.709 INFO:teuthology.orchestra.run.smithi103.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 38 kB/s | 16 kB 00:00 2024-09-16T16:44:26.835 INFO:teuthology.orchestra.run.smithi103.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-16T16:44:26.876 INFO:teuthology.orchestra.run.smithi103.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 5.1 MB/s | 863 kB 00:00 2024-09-16T16:44:26.952 INFO:teuthology.orchestra.run.smithi103.stdout:(5/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-16T16:44:26.969 INFO:teuthology.orchestra.run.smithi103.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 215 kB/s | 19 kB 00:00 2024-09-16T16:44:27.002 INFO:teuthology.orchestra.run.smithi103.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-16T16:44:27.019 INFO:teuthology.orchestra.run.smithi103.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-16T16:44:27.053 INFO:teuthology.orchestra.run.smithi103.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-16T16:44:27.145 INFO:teuthology.orchestra.run.smithi103.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-16T16:44:33.445 INFO:teuthology.orchestra.run.smithi103.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 2.0 MB/s | 14 MB 00:07 2024-09-16T16:44:33.449 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:33.450 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.2 MB/s | 18 MB 00:08 2024-09-16T16:44:33.483 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:44:33.504 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:44:33.504 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:44:33.765 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:44:33.765 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:44:34.309 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:44:34.401 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:44:34.431 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:44:34.520 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:44:34.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:44:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:44:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:44:34.863 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:44:34.891 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:34.923 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:44:38.123 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:44:38.195 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:44:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:44:40.172 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:44:40.172 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:44:40.172 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:40.172 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:44:40.172 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:44:40.469 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:44:40.469 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:40.469 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:40.470 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:44:40.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:44:41.298 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:26 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:44:41.433 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:44:41.434 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:44:41.435 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-16T16:44:41.436 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-09-16T16:44:41.436 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:44:41.436 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 38 M 2024-09-16T16:44:41.436 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 212 M 2024-09-16T16:44:41.436 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:44:42.020 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 622 kB/s | 191 kB 00:00 2024-09-16T16:44:42.311 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2024-09-16T16:44:42.428 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-16T16:44:42.720 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 62 kB/s | 18 kB 00:00 2024-09-16T16:44:42.929 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 185 kB/s | 38 kB 00:00 2024-09-16T16:44:43.229 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-16T16:44:43.354 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-16T16:44:43.863 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-16T16:44:43.988 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-16T16:44:44.065 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.3 MB/s | 4.9 MB 00:01 2024-09-16T16:44:44.572 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): ceph-mgr-diskprediction-local-19.3.0-4 2.6 MB/s | 7.4 MB 00:02 2024-09-16T16:44:46.112 INFO:teuthology.orchestra.run.smithi142.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.2 MB/s | 70 MB 00:32 2024-09-16T16:44:46.117 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:46.117 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 84 MB 00:34 2024-09-16T16:44:46.266 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:44:46.307 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:44:46.307 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:44:47.115 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:44:47.116 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:44:48.741 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:44:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:48.867 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:48.945 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:49.016 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:49.048 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:49.140 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:49.218 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:49.259 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:49.294 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:49.324 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:49.484 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:49.519 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:49.575 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:49.608 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:49.680 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:44:49.818 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:44:49.899 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:44:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:44:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:44:50.048 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:44:50.103 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:44:50.290 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:44:50.337 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:44:50.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:44:50.503 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:44:50.554 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:44:50.688 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:44:50.880 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:44:50.913 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:50.939 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:01.564 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:01.592 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:02.140 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:02.163 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:02.163 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.163 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:45:02.164 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:02.164 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:02.164 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:02.398 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:02.422 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.422 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:45:02.422 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:02.422 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 836 kB/s | 16 MB 00:19 2024-09-16T16:45:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-16T16:45:04.262 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:04.289 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:04.289 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:04.717 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:04.717 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:06.675 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:06.792 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:08.044 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:09.042 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:09.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:45:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:45:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:45:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:45:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:45:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:45:09.087 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:09.995 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:45:09.996 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:45:09.997 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:09.998 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:10.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-09-16T16:45:10.854 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:03:53 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:10.945 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:10.986 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:10.988 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:45:10.988 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:11.066 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-09-16T16:45:11.633 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:03:54 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:11.668 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:11.668 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:11.669 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:11.766 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:45:11.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:11.768 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 785 k 2024-09-16T16:45:11.768 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 791 k 2024-09-16T16:45:11.768 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:12.067 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:12.289 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.5 MB/s | 785 kB 00:00 2024-09-16T16:45:12.290 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:12.290 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.5 MB/s | 785 kB 00:00 2024-09-16T16:45:12.290 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:12.296 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:12.296 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:12.302 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:12.302 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:12.546 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:13.127 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:03:58 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:13.262 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:13.263 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout:Install 13 Packages 2024-09-16T16:45:13.264 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:13.265 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.2 M 2024-09-16T16:45:13.265 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-09-16T16:45:13.265 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:13.599 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:13.731 INFO:teuthology.orchestra.run.smithi103.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 348 kB/s | 26 kB 00:00 2024-09-16T16:45:13.756 INFO:teuthology.orchestra.run.smithi103.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 194 kB/s | 19 kB 00:00 2024-09-16T16:45:13.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:45:13.873 INFO:teuthology.orchestra.run.smithi103.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-16T16:45:13.898 INFO:teuthology.orchestra.run.smithi103.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-16T16:45:13.940 INFO:teuthology.orchestra.run.smithi103.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.3 MB/s | 54 kB 00:00 2024-09-16T16:45:13.974 INFO:teuthology.orchestra.run.smithi103.stdout:(6/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 155 kB/s | 49 kB 00:00 2024-09-16T16:45:13.999 INFO:teuthology.orchestra.run.smithi103.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-09-16T16:45:14.033 INFO:teuthology.orchestra.run.smithi103.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 348 kB/s | 32 kB 00:00 2024-09-16T16:45:14.067 INFO:teuthology.orchestra.run.smithi103.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 155 kB/s | 14 kB 00:00 2024-09-16T16:45:14.092 INFO:teuthology.orchestra.run.smithi103.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-16T16:45:14.126 INFO:teuthology.orchestra.run.smithi103.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-16T16:45:14.159 INFO:teuthology.orchestra.run.smithi103.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.7 MB/s | 1.0 MB 00:00 2024-09-16T16:45:14.184 INFO:teuthology.orchestra.run.smithi103.stdout:(13/13): python3-google-auth-2.34.0-1.el9.noarc 1.2 MB/s | 220 kB 00:00 2024-09-16T16:45:14.188 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:14.188 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-16T16:45:14.253 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:14.269 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:14.269 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:14.358 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:14.359 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:14.390 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:03:57 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:14.527 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:14.527 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:14.527 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 158 k 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 644 k 2024-09-16T16:45:14.528 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:14.970 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 357 kB/s | 158 kB 00:00 2024-09-16T16:45:14.971 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:14.971 INFO:teuthology.orchestra.run.smithi142.stdout:Total 356 kB/s | 158 kB 00:00 2024-09-16T16:45:14.971 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:14.981 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:14.981 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:15.038 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:15.038 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:15.050 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:15.119 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:15.175 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:15.212 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:15.253 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:15.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:15.279 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:15.280 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:15.280 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:45:15.280 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:15.356 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:15.466 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:15.522 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:16.241 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:16.295 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:16.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-09-16T16:45:17.036 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:00 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:17.129 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:17.173 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:17.174 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:45:17.174 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:17.182 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:17.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:17.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:17.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:17.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:45:17.522 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:17.522 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:17.522 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:17.522 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:17.522 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:17.523 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:17.800 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:00 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:17.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:17.933 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:45:17.934 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout:Install 11 Packages 2024-09-16T16:45:17.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:17.936 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 18 M 2024-09-16T16:45:17.936 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 155 M 2024-09-16T16:45:17.936 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:18.379 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:03 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:18.513 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:18.514 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-09-16T16:45:18.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 7.0 M 2024-09-16T16:45:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 33 M 2024-09-16T16:45:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:18.721 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-16T16:45:18.797 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.2 MB/s | 548 kB 00:00 2024-09-16T16:45:18.822 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-16T16:45:18.848 INFO:teuthology.orchestra.run.smithi142.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 122 kB/s | 34 kB 00:00 2024-09-16T16:45:18.855 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-16T16:45:18.865 INFO:teuthology.orchestra.run.smithi142.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 55 kB/s | 16 kB 00:00 2024-09-16T16:45:18.939 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T16:45:19.023 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 344 kB/s | 154 kB 00:00 2024-09-16T16:45:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:19.025 INFO:teuthology.orchestra.run.smithi103.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-16T16:45:19.095 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:19.207 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:19.207 INFO:teuthology.orchestra.run.smithi142.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.5 MB/s | 863 kB 00:00 2024-09-16T16:45:19.208 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:19.274 INFO:teuthology.orchestra.run.smithi142.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.1 MB/s | 548 kB 00:00 2024-09-16T16:45:19.291 INFO:teuthology.orchestra.run.smithi142.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-16T16:45:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:(6/11): python3-protobuf-3.14.0-13.el9.noarch.r 566 kB/s | 269 kB 00:00 2024-09-16T16:45:19.383 INFO:teuthology.orchestra.run.smithi142.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-16T16:45:19.400 INFO:teuthology.orchestra.run.smithi142.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-16T16:45:19.450 INFO:teuthology.orchestra.run.smithi142.stdout:(9/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-09-16T16:45:19.476 INFO:teuthology.orchestra.run.smithi142.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-16T16:45:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:19.689 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:19.735 INFO:teuthology.orchestra.run.smithi142.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 12 MB/s | 14 MB 00:01 2024-09-16T16:45:19.739 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:19.739 INFO:teuthology.orchestra.run.smithi142.stdout:Total 10 MB/s | 18 MB 00:01 2024-09-16T16:45:19.750 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:19.772 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:19.793 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:19.793 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:20.058 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:20.059 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:20.288 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:20.370 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:20.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:20.481 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:20.682 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:45:20.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:45:20.820 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:45:20.948 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:45:21.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:45:21.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:45:21.136 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:45:21.165 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:21.197 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:21.293 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:21.580 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:21.581 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:21.581 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:21.581 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:21.581 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:21.581 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:21.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse 2024-09-16T16:45:22.443 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:07 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:22.576 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:22.577 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-09-16T16:45:22.578 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 964 k 2024-09-16T16:45:22.578 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 4.1 M 2024-09-16T16:45:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:22.860 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 522 kB/s | 80 kB 00:00 2024-09-16T16:45:23.251 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 1.6 MB/s | 884 kB 00:00 2024-09-16T16:45:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:23.252 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.4 MB/s | 964 kB 00:00 2024-09-16T16:45:23.265 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:23.289 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:23.369 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:23.556 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:23.705 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:23.784 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:24.387 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:45:24.443 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:24.486 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:24.486 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:24.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:24.771 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:24.772 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:24.772 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:24.772 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:24.772 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:25.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-volume 2024-09-16T16:45:25.669 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:10 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:25.808 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:25.809 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 285 k 2024-09-16T16:45:25.810 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 1.3 M 2024-09-16T16:45:25.810 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:26.257 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 637 kB/s | 285 kB 00:00 2024-09-16T16:45:26.258 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:26.259 INFO:teuthology.orchestra.run.smithi103.stdout:Total 635 kB/s | 285 kB 00:00 2024-09-16T16:45:26.259 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:26.267 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:26.267 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:26.299 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:26.299 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:26.401 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:45:26.402 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:45:26.525 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:26.593 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:26.610 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:26.610 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:26.610 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:26.610 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:45:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:45:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:45:26.709 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:26.709 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:26.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:45:27.530 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:10 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:27.622 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:27.664 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:45:27.666 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-09-16T16:45:27.667 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:27.668 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-09-16T16:45:27.668 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 212 M 2024-09-16T16:45:27.668 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:27.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel 2024-09-16T16:45:28.067 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-16T16:45:28.109 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-16T16:45:28.401 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-16T16:45:28.546 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:13 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:28.668 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-09-16T16:45:28.683 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:28.684 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:28.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:28.685 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 125 k 2024-09-16T16:45:28.685 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 445 k 2024-09-16T16:45:28.685 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:28.885 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-09-16T16:45:28.897 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 591 kB/s | 125 kB 00:00 2024-09-16T16:45:28.897 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:28.898 INFO:teuthology.orchestra.run.smithi103.stdout:Total 586 kB/s | 125 kB 00:00 2024-09-16T16:45:28.898 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:28.903 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:28.903 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:28.967 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:28.967 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:29.126 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:29.220 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:29.260 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-16T16:45:29.711 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:29.827 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 1.7 MB/s | 3.0 MB 00:01 2024-09-16T16:45:29.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:29.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:29.961 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:29.961 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:29.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:29.961 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:30.152 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 274 kB/s | 245 kB 00:00 2024-09-16T16:45:30.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2 2024-09-16T16:45:30.744 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 2.7 MB/s | 4.9 MB 00:01 2024-09-16T16:45:30.800 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:15 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:30.892 INFO:teuthology.orchestra.run.smithi103.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:30.936 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:30.937 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:30.937 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:31.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs-devel 2024-09-16T16:45:31.028 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 287 kB/s | 250 kB 00:00 2024-09-16T16:45:31.585 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:16 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:31.721 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 32 k 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 142 k 2024-09-16T16:45:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:31.944 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 143 kB/s | 32 kB 00:00 2024-09-16T16:45:31.944 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:31.945 INFO:teuthology.orchestra.run.smithi103.stdout:Total 142 kB/s | 32 kB 00:00 2024-09-16T16:45:31.945 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:31.948 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:31.948 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:31.960 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:31.961 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:31.986 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.4 MB/s | 5.1 MB 00:02 2024-09-16T16:45:32.053 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:32.168 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:32.538 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:32.810 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:33.009 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2 2024-09-16T16:45:33.577 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:18 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:33.644 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-16T16:45:33.646 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:33.646 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.4 MB/s | 38 MB 00:05 2024-09-16T16:45:33.666 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:33.709 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:33.711 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:33.711 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:33.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1 2024-09-16T16:45:34.006 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:34.033 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:34.033 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:34.348 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:19 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:34.439 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:34.464 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:34.464 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:34.483 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:34.484 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:34.485 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:34.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados 2024-09-16T16:45:35.125 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:20 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:35.217 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:35.261 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:35.262 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:35.262 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:35.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:35.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw 2024-09-16T16:45:35.342 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:35.450 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:35.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:35.685 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:35.718 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:35.794 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:35.895 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:20 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:35.983 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:36.026 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:36.027 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:36.027 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:36.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs 2024-09-16T16:45:36.454 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:36.565 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:36.666 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:21 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:36.757 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:36.799 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:36.800 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:36.800 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:36.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd 2024-09-16T16:45:37.426 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:22 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:37.517 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:37.561 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:37.562 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-16T16:45:37.562 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:37.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse 2024-09-16T16:45:37.798 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:38.187 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:23 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:38.320 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:38.321 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:38.322 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:38.322 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 91 k 2024-09-16T16:45:38.322 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 321 k 2024-09-16T16:45:38.322 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:38.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:38.850 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:40.689 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 38 kB/s | 91 kB 00:02 2024-09-16T16:45:40.689 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:40.690 INFO:teuthology.orchestra.run.smithi103.stdout:Total 38 kB/s | 91 kB 00:02 2024-09-16T16:45:40.690 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:40.701 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:40.701 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:40.769 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:40.769 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:40.916 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:41.011 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:41.402 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:41.568 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:41.568 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:41.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:41.662 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:41.663 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:41.663 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:41.663 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:41.663 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:41.663 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:41.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:42.018 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:42.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:42.541 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:27 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:42.680 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:42.680 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:42.680 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:42.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.5 M 2024-09-16T16:45:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 30 M 2024-09-16T16:45:42.682 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:42.982 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:25 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:43.028 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-16T16:45:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-16T16:45:43.029 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:43.041 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:43.041 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:43.117 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:43.118 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:43.119 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-09-16T16:45:43.120 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:43.121 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-09-16T16:45:43.121 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-09-16T16:45:43.121 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:43.127 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:43.127 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:43.400 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 287 kB/s | 49 kB 00:00 2024-09-16T16:45:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 80 kB/s | 19 kB 00:00 2024-09-16T16:45:43.492 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 97 kB/s | 26 kB 00:00 2024-09-16T16:45:43.715 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:43.762 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:43.789 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:43.859 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 405 kB/s | 159 kB 00:00 2024-09-16T16:45:43.884 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 459 kB/s | 222 kB 00:00 2024-09-16T16:45:43.934 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 642 kB/s | 32 kB 00:00 2024-09-16T16:45:43.960 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 596 kB/s | 279 kB 00:00 2024-09-16T16:45:43.985 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 281 kB/s | 14 kB 00:00 2024-09-16T16:45:44.044 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 2.6 MB/s | 220 kB 00:00 2024-09-16T16:45:44.077 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-16T16:45:44.111 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-16T16:45:44.169 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-16T16:45:44.195 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 160 kB/s | 54 kB 00:00 2024-09-16T16:45:44.197 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:44.197 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-16T16:45:44.265 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:44.280 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:44.280 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:44.367 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:44.368 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:45.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:45.062 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:45.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:45.167 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:45.205 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:45.246 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:45.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd 2024-09-16T16:45:45.347 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:45.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:45.515 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:45.897 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:04:30 ago on Mon 16 Sep 2024 04:41:15 PM UTC. 2024-09-16T16:45:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-16T16:45:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:46.035 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 177 k 2024-09-16T16:45:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 685 k 2024-09-16T16:45:46.037 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-16T16:45:46.226 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:46.243 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 856 kB/s | 177 kB 00:00 2024-09-16T16:45:46.244 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:46.244 INFO:teuthology.orchestra.run.smithi103.stdout:Total 849 kB/s | 177 kB 00:00 2024-09-16T16:45:46.244 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-16T16:45:46.254 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-16T16:45:46.254 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-16T16:45:46.279 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:46.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:46.323 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-16T16:45:46.324 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-16T16:45:46.360 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:46.382 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:46.502 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-16T16:45:46.608 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:47.152 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:47.153 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:47.153 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:47.153 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:47.153 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:47.325 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:47.325 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:47.326 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-16T16:45:47.326 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:47.326 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:45:47.326 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:47.488 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:47.614 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:47.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:48.306 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:31 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:48.441 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:48.442 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-09-16T16:45:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:48.780 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-16T16:45:48.864 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 739 kB/s | 154 kB 00:00 2024-09-16T16:45:48.897 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.6 MB/s | 548 kB 00:00 2024-09-16T16:45:48.931 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.7 MB/s | 74 kB 00:00 2024-09-16T16:45:48.964 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 575 kB/s | 58 kB 00:00 2024-09-16T16:45:50.081 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-09-16T16:45:50.084 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:50.084 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.3 MB/s | 7.0 MB 00:01 2024-09-16T16:45:50.154 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:50.166 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:50.166 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:50.267 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:50.269 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:50.577 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:50.749 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:50.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:51.331 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:51.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:51.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:51.520 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:52.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:52.569 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:52.570 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:52.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-09-16T16:45:53.398 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:36 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:53.530 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:53.530 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-09-16T16:45:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:53.532 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 964 k 2024-09-16T16:45:53.532 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 4.1 M 2024-09-16T16:45:53.532 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:53.800 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 517 kB/s | 80 kB 00:00 2024-09-16T16:45:53.941 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 2.9 MB/s | 884 kB 00:00 2024-09-16T16:45:53.942 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:53.942 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.3 MB/s | 964 kB 00:00 2024-09-16T16:45:53.954 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:53.977 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:53.977 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:54.057 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:54.058 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:54.244 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:54.385 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:54.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:55.242 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:55.518 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:55.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2024-09-16T16:45:56.394 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:39 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:56.536 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:45:56.537 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:56.538 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 285 k 2024-09-16T16:45:56.538 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.3 M 2024-09-16T16:45:56.538 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:56.755 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T16:45:56.756 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:56.756 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T16:45:56.756 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:56.765 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:56.765 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:56.798 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:56.799 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:57.028 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:57.090 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:57.107 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:57.107 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:57.108 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:57.108 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:58.135 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:45:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:58.136 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:45:58.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-09-16T16:45:59.020 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:42 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:45:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:45:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 125 k 2024-09-16T16:45:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 445 k 2024-09-16T16:45:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:45:59.352 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 649 kB/s | 125 kB 00:00 2024-09-16T16:45:59.352 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:59.352 INFO:teuthology.orchestra.run.smithi142.stdout:Total 644 kB/s | 125 kB 00:00 2024-09-16T16:45:59.352 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:45:59.358 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:45:59.358 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:45:59.422 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:45:59.422 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:45:59.585 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:45:59.691 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:00.137 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:00.414 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:00.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-09-16T16:46:01.222 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:44 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:01.314 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:01.358 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:01.359 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:01.359 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:01.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-09-16T16:46:02.018 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:45 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:02.150 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:02.151 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:02.151 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-16T16:46:02.151 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:02.151 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 32 k 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 142 k 2024-09-16T16:46:02.152 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:46:02.297 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 220 kB/s | 32 kB 00:00 2024-09-16T16:46:02.297 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:02.298 INFO:teuthology.orchestra.run.smithi142.stdout:Total 217 kB/s | 32 kB 00:00 2024-09-16T16:46:02.298 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:46:02.301 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:46:02.301 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:46:02.323 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:46:02.324 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:46:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:46:02.544 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:02.954 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:03.199 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:03.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-09-16T16:46:03.964 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:46 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:04.055 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:04.098 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:04.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-09-16T16:46:04.727 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:47 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:04.818 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:04.862 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:04.863 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:04.863 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:04.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-09-16T16:46:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:48 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:05.585 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:05.629 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:05.631 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:05.631 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:05.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-09-16T16:46:06.260 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:49 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:06.351 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:06.395 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:06.396 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:06.396 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:06.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-09-16T16:46:07.032 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:50 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:07.130 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:07.176 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:07.177 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:07.177 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:07.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-09-16T16:46:07.839 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:50 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:07.929 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:07.972 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:07.973 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-09-16T16:46:07.974 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:08.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-09-16T16:46:08.609 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:51 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:08.742 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:46:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:08.744 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 91 k 2024-09-16T16:46:08.744 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 321 k 2024-09-16T16:46:08.744 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:46:08.950 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 442 kB/s | 91 kB 00:00 2024-09-16T16:46:08.950 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:08.950 INFO:teuthology.orchestra.run.smithi142.stdout:Total 439 kB/s | 91 kB 00:00 2024-09-16T16:46:08.950 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:46:08.959 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:46:08.959 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:46:09.022 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:46:09.023 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:46:09.170 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:46:09.272 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.667 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:09.950 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:10.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-09-16T16:46:10.816 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:53 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:10.955 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:10.956 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:46:10.957 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:10.957 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.5 M 2024-09-16T16:46:10.957 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 30 M 2024-09-16T16:46:10.957 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:46:11.661 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 5.0 MB/s | 3.5 MB 00:00 2024-09-16T16:46:11.662 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:11.663 INFO:teuthology.orchestra.run.smithi142.stdout:Total 5.0 MB/s | 3.5 MB 00:00 2024-09-16T16:46:11.663 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:46:11.674 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:46:11.674 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:46:11.759 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:46:11.759 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:46:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:46:12.420 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.445 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.445 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:12.445 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:46:12.446 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:12.446 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:12.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:13.665 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:13.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-09-16T16:46:14.541 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:04:57 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:46:14.679 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-16T16:46:14.679 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:14.679 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:14.679 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:14.680 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 177 k 2024-09-16T16:46:14.681 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 685 k 2024-09-16T16:46:14.681 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-16T16:46:14.890 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 845 kB/s | 177 kB 00:00 2024-09-16T16:46:14.890 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:14.890 INFO:teuthology.orchestra.run.smithi142.stdout:Total 840 kB/s | 177 kB 00:00 2024-09-16T16:46:14.891 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-16T16:46:14.900 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-16T16:46:14.900 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-16T16:46:14.970 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-16T16:46:14.970 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-16T16:46:15.144 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-16T16:46:15.237 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.644 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.898 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.899 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:15.899 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-16T16:46:15.899 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:15.899 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:15.899 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-16T16:46:16.169 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:16.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:16.309 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:16.336 INFO:teuthology.orchestra.run.smithi103.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.337 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.337 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:16.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:16.483 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:16.506 INFO:teuthology.orchestra.run.smithi142.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.506 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:16.506 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:16.507 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:46:16.508 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:16.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:16.539 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:16.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:16.574 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:46:16.574 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:16.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:16.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:16.676 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:16.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:16.704 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:16.772 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:46:16.773 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:16.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:16.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:16.866 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:16.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:16.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:16.980 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:46:16.980 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:16.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:17.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:17.071 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:17.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:17.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:17.165 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:46:17.245 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:46:17.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:17.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:17.274 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:46:17.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:17.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:17.340 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:46:17.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:17.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:17.415 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:46:17.415 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:46:17.415 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench}', 'email': None, 'first_in_suite': False, 'job_id': '7907370', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkAruWnHPeuPtXrCB60FyOu4Lzf2BDkxbVjj3D9nPJx4ju9tCgydEtAIlr1kFW3JrUyLnmREL9cB30ZKhr7iMc=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCUjRjabzKSC98JmCCrC/Hk1HL7IUhnwnNb8TEvE8tUjA1B6hmcZGpUlefQD3uJkZzm5/saVt1dntD3rHDtvbA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:46:17.415 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:17.445 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:17.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:17.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:17.528 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:17.528 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:17.581 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:17.581 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:17.637 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-16 16:45:44.040807592 +0000 2024-09-16T16:46:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-16 16:40:32.813853481 +0000 2024-09-16T16:46:17.638 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-16 16:40:32.813853481 +0000 2024-09-16T16:46:17.638 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-16 16:40:32.813853481 +0000 2024-09-16T16:46:17.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:17.700 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-16T16:46:17.700 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-16T16:46:17.700 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000185159 s, 2.8 MB/s 2024-09-16T16:46:17.701 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:17.759 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:17.814 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-16 16:45:44.040807592 +0000 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-16 16:40:33.153847043 +0000 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-16 16:40:33.153847043 +0000 2024-09-16T16:46:17.815 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-16 16:40:33.153847043 +0000 2024-09-16T16:46:17.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:17.877 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-16T16:46:17.878 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-16T16:46:17.878 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000214867 s, 2.4 MB/s 2024-09-16T16:46:17.879 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:17.934 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:17.990 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:17.990 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:17.990 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-16 16:45:44.041807573 +0000 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-16 16:40:33.472841003 +0000 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-16 16:40:33.472841003 +0000 2024-09-16T16:46:17.991 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-16 16:40:33.472841003 +0000 2024-09-16T16:46:17.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-16T16:46:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-16T16:46:18.053 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000219113 s, 2.3 MB/s 2024-09-16T16:46:18.055 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:18.111 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:18.167 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:18.167 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T16:46:18.167 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-16 16:45:44.041807573 +0000 2024-09-16T16:46:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-16 16:40:33.792834944 +0000 2024-09-16T16:46:18.168 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-16 16:40:33.792834944 +0000 2024-09-16T16:46:18.168 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-16 16:40:33.792834944 +0000 2024-09-16T16:46:18.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:18.231 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-16T16:46:18.231 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-16T16:46:18.231 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000191696 s, 2.7 MB/s 2024-09-16T16:46:18.233 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:18.289 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:18.289 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:18.289 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:18.308 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:18.308 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:18.367 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:18.367 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.367 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T16:46:18.367 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.367 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.368 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-16 16:46:12.705171259 +0000 2024-09-16T16:46:18.368 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-16 16:40:32.819074258 +0000 2024-09-16T16:46:18.368 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-16 16:40:32.819074258 +0000 2024-09-16T16:46:18.368 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-16 16:40:32.819074258 +0000 2024-09-16T16:46:18.368 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:18.436 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-16T16:46:18.436 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-16T16:46:18.436 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000216772 s, 2.4 MB/s 2024-09-16T16:46:18.437 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:18.496 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:18.553 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-16 16:46:12.705171259 +0000 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-16 16:40:33.142068116 +0000 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-16 16:40:33.142068116 +0000 2024-09-16T16:46:18.554 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-16 16:40:33.142068116 +0000 2024-09-16T16:46:18.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:18.619 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-16T16:46:18.619 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-16T16:46:18.619 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.00026149 s, 2.0 MB/s 2024-09-16T16:46:18.621 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:18.678 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:18.734 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.734 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T16:46:18.734 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.734 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.735 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-16 16:46:12.706171240 +0000 2024-09-16T16:46:18.735 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-16 16:40:33.482061651 +0000 2024-09-16T16:46:18.735 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-16 16:40:33.482061651 +0000 2024-09-16T16:46:18.735 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-16 16:40:33.482061651 +0000 2024-09-16T16:46:18.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:18.799 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-16T16:46:18.800 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-16T16:46:18.800 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000207227 s, 2.5 MB/s 2024-09-16T16:46:18.801 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:18.858 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-16 16:46:12.706171240 +0000 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-16 16:40:33.818055262 +0000 2024-09-16T16:46:18.914 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-16 16:40:33.818055262 +0000 2024-09-16T16:46:18.915 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-16 16:40:33.818055262 +0000 2024-09-16T16:46:18.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-16T16:46:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-16T16:46:18.978 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000230053 s, 2.2 MB/s 2024-09-16T16:46:18.979 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:19.035 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:19.035 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:19.035 INFO:tasks.ceph:Generating config... 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-16T16:46:19.037 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-16T16:46:19.038 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-16T16:46:19.038 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:46:19.038 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-16T16:46:19.038 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-16T16:46:19.038 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-16T16:46:19.038 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-16T16:46:19.038 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.038 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:46:19.038 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:46:19.038 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:46:19.039 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:46:19.039 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:46:19.039 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:46:19.039 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-16T16:46:19.039 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:46:19.039 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:46:19.040 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:46:19.040 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:46:19.040 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.040 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.040 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.040 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.040 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:46:19.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:19.104 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:46:19.107 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:46:19.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.184 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103')] 2024-09-16T16:46:19.184 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T16:46:19.185 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:19.185 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:19.239 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:19.330+0000 7f2e1042bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:19.331+0000 7f2e1042bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:19.331+0000 7f2e1042bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid f25e6613-aa37-429e-93f8-21da834447fa 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:fsid f25e6613-aa37-429e-93f8-21da834447fa 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-09-16T16:46:19.332192+0000 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-16T16:46:19.332192+0000 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-16T16:46:19.332 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:46:19.333 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:19.348 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f25e6613-aa37-429e-93f8-21da834447fa... 2024-09-16T16:46:19.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:19.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-16T16:46:19.432 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-16T16:46:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = 172.21.15.103 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms client mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms cluster mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon client mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon cluster mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms mon service mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: ms service mode = crc 2024-09-16T16:46:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_min_size = 2 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_size = 3 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = f25e6613-aa37-429e-93f8-21da834447fa 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 120 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: debug monc = 20 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug reject backfill probability = 0.3 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd delete sleep = 1 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd max backfills = 3 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd max markdown count = 1000 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = seastore 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub min interval = 60 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: osd snap trim sleep = 2 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-16T16:46:19.439 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: mgr stats period = 30 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-16T16:46:19.440 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.441 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default crimson = True 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: paxos service trim min = 10 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:19.442 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: debug objecter = 20 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: debug rados = 20 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.443 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi103.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-09-16T16:46:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-09-16T16:46:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-09-16T16:46:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = 172.21.15.103 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: ms client mode = crc 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: ms cluster mode = crc 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon client mode = crc 2024-09-16T16:46:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon cluster mode = crc 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: ms mon service mode = crc 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: ms service mode = crc 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_min_size = 2 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_size = 3 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = f25e6613-aa37-429e-93f8-21da834447fa 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 120 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: debug monc = 20 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug reject backfill probability = 0.3 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd delete sleep = 1 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd max backfills = 3 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd max markdown count = 1000 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = seastore 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub min interval = 60 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: osd snap trim sleep = 2 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mgr stats period = 30 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-09-16T16:46:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default crimson = True 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: paxos service trim min = 10 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: debug objecter = 20 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: debug rados = 20 2024-09-16T16:46:19.455 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-09-16T16:46:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:19.457 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:46:19.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:46:19.560 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:46:19.561 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:19.561 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:46:19.576 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:19.576 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:46:19.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T16:46:19.631 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:19.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:19.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.705 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:19.705 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.760 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T16:46:19.760 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:19.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:19.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:19.797 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:19.798 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:19.854 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:46:19.854 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:46:19.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:19.972 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:19.975 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:46:19.975 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:46:19.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:20.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:20.101 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:46:20.102 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:20.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:20.127 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:20.127 INFO:tasks.ceph:role: osd.0 2024-09-16T16:46:20.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T16:46:20.127 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:20.199 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:20.200 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:20.200 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:20.722 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-16T16:46:20.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-16T16:46:20.724 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:20.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:20.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:20.931 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:20.931 INFO:tasks.ceph:role: osd.1 2024-09-16T16:46:20.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T16:46:20.931 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:21.002 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:21.003 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:21.468 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-16T16:46:21.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-16T16:46:21.470 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:21.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:21.591 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:21.896 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:21.897 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:21,897 seastar - Reactor backend: linux-aio 2024-09-16T16:46:21.908 INFO:teuthology.orchestra.run.smithi103.stderr:==27584==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:22.041 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:22,041 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:22.041 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:22,041 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:22.042 INFO:teuthology.orchestra.run.smithi103.stderr:DEBUG 2024-09-16 16:46:22,042 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:22.554 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:22.554 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-16T16:46:22.555 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-16T16:46:22.555 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:22.555 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:22.555 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T16:46:22.611 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:22.614 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:22,615 seastar - Reactor backend: linux-aio 2024-09-16T16:46:22.624 INFO:teuthology.orchestra.run.smithi103.stderr:==27582==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c2c 0xdd332 0x4ab1c 0x45855bb 0x4621f13 0x5fdbff1 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:22.689 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:22.912 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xf8db9 0x36085c6 0x3613d76 0x362a1be 0x382b1d8 0x9c1c1ce 0x9c1c484 0x9af9615 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:22.912 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:22.912 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42241 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb8539b6 0xb853a6f 0xb853f61 0xb85436c 0xb85462b 0xb8550e8 0xba25db6 0xb9caf71 0x9af99b1 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:22.912 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d767 0x10af7c 0x4225d 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb8539b6 0xb853f61 0xb85436c 0xb85462b 0xb9dab79 0xb9c7696 0xb9c7a7a 0x9afe8a1 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:22.969 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xba39383 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9ab25f7 0x9afe286 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:22.970 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.118 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10798a 0xdd2e1 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.118 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.176 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33966 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.176 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.212 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abcb 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.212 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.213 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x554276d 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.213 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.270 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542d10 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.270 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.271 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.271 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55420a9 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.283 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.378 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55422d9 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.378 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.378 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cb6 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:23.378 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:23.678 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542c0f 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:23.679 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:24.588 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:24.589 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-16T16:46:24.589 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-16T16:46:24.589 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:24.589 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:24.589 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T16:46:24.616 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:24.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:24.919 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:24.920 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:24,920 seastar - Reactor backend: linux-aio 2024-09-16T16:46:24.925 INFO:teuthology.orchestra.run.smithi103.stderr:==27631==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5f85b30 0x5fe9d1a 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:25,052 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:25.052 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:25,052 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:25.053 INFO:teuthology.orchestra.run.smithi103.stderr:DEBUG 2024-09-16 16:46:25,053 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:25.557 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:25.558 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-16T16:46:25.558 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-16T16:46:25.558 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:25.558 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:25.558 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T16:46:25.619 INFO:teuthology.orchestra.run.smithi103.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:25.622 INFO:teuthology.orchestra.run.smithi103.stderr:INFO 2024-09-16 16:46:25,623 seastar - Reactor backend: linux-aio 2024-09-16T16:46:25.649 INFO:teuthology.orchestra.run.smithi103.stderr:==27629==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb853a42 0xb853f61 0xb85436c 0xb85462b 0xb8550e8 0xba25db6 0xb9caf71 0x9af9f97 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0xb9f75c4 0xba04cbd 0xba33d3f 0xba34389 0xb9ceb14 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.004 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3789bd4 0xba1c1c8 0xba35301 0xb9d20ef 0xb9d2514 0xb9d84d7 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9ab25f7 0x9afe286 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.004 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abb7 0x3ac7b0e 0x3b8c26d 0xb9fdc0e 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9ab25f7 0x9afe286 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.004 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.004 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156cf 0xdd312 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.161 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.218 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542108 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.218 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.241 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c3f 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.241 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.276 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cc1 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.276 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.298 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cc1 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.298 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.326 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55426e3 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.326 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.333 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542d45 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.334 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.406 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 197 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10798d 0xdd2fc 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.406 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.441 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4aba4 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:26.441 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.734 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542d10 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.734 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:26.791 INFO:teuthology.orchestra.run.smithi103.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab17 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:26.791 INFO:teuthology.orchestra.run.smithi103.stderr:kernel callstack: 2024-09-16T16:46:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:Suppressions used: 2024-09-16T16:46:27.652 INFO:teuthology.orchestra.run.smithi103.stderr: count bytes template 2024-09-16T16:46:27.652 INFO:teuthology.orchestra.run.smithi103.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:27.652 INFO:teuthology.orchestra.run.smithi103.stderr:----------------------------------------------------- 2024-09-16T16:46:27.652 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T16:46:27.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:27.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:27.732 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:27.732 INFO:tasks.ceph:role: osd.2 2024-09-16T16:46:27.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T16:46:27.732 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:27.808 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:27.808 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:27.809 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:28.320 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-16T16:46:28.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-16T16:46:28.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:28.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:28.501 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:28.567 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:28.567 INFO:tasks.ceph:role: osd.3 2024-09-16T16:46:28.567 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T16:46:28.567 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:28.638 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:28.639 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:29.090 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-09-16T16:46:29.092 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-09-16T16:46:29.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:29.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:29.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:29.505 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:29.506 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:29,506 seastar - Reactor backend: linux-aio 2024-09-16T16:46:29.517 INFO:teuthology.orchestra.run.smithi142.stderr:==27594==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3629ff9 0x362a21d 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:29.624 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:29.637 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:29,637 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:29.637 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:29,637 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:29.638 INFO:teuthology.orchestra.run.smithi142.stderr:DEBUG 2024-09-16 16:46:29,638 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:30.161 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-16T16:46:30.219 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:30.222 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:30,223 seastar - Reactor backend: linux-aio 2024-09-16T16:46:30.232 INFO:teuthology.orchestra.run.smithi142.stderr:==27592==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:30.514 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42258 0x3ef7b 0xfd531 0x95e2cb5 0x95e390c 0x95e3dd5 0x9af9ca7 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.515 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x377a6db 0x3b8c187 0x3b8c278 0xb9fdc0e 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.515 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.515 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.572 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3611fce 0x3b8bffd 0x3b8c278 0xb9effcb 0xb9f3a39 0xba3745c 0xb9da272 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.572 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.573 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4218f 0x3ecea 0xfc9b1 0x387d3bb 0x387d757 0x9e0e618 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.573 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.692 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x554214f 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.692 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.749 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541fff 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.750 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.783 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd2f7 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.783 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.783 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542f29 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.783 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542c72 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.841 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33934 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:30.857 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542f29 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:30.948 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4aba4 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:31.271 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x390ff 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:31.328 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-16T16:46:32.177 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-16T16:46:32.177 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:32.177 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:32.178 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-16T16:46:32.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:32.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:32.506 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:32.507 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:32,507 seastar - Reactor backend: linux-aio 2024-09-16T16:46:32.512 INFO:teuthology.orchestra.run.smithi142.stderr:==27641==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d75f 0xdd31a 0x4ab1c 0x5fe9be6 0x5fe9dfc 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:32.619 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:32.631 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:32,632 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:32.631 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:32,632 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:32.632 INFO:teuthology.orchestra.run.smithi142.stderr:DEBUG 2024-09-16 16:46:32,633 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:33.138 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:33.139 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-16T16:46:33.139 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-16T16:46:33.139 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:33.139 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:33.139 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-16T16:46:33.196 INFO:teuthology.orchestra.run.smithi142.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:33.201 INFO:teuthology.orchestra.run.smithi142.stderr:INFO 2024-09-16 16:46:33,201 seastar - Reactor backend: linux-aio 2024-09-16T16:46:33.217 INFO:teuthology.orchestra.run.smithi142.stderr:==27639==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:33.501 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4bf94 0x9843621 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.501 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x161f42 0xc928c 0xc9e39 0x36084f8 0x3b8c080 0x3b8c278 0xb9e909a 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba02054 0xba313d1 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.502 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.559 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x119673 0x11d39b 0x41608 0x41bbe 0x41c92 0x41f68 0x4214e 0x3ef7b 0xfd531 0x3c34f60 0x55593bc 0x9ed0efd 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.559 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb60e3f2b 0xffffffffb5555eda 0xffffffffb55562ca 0xffffffffb558ae8a 0xffffffffb558af01 0xffffffffb576cd62 0xffffffffb60cd45f 0xffffffffb6200130 2024-09-16T16:46:33.559 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4b200 0x555933b 0x9ed0efd 0x9ed14b6 0x9ed185e 0x9ed4c38 0x9ed5894 0x9ed5b57 0x9ed67ce 0x9e21d32 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.559 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.689 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542745 0x9e3397b 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.689 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.747 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abcb 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.747 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.817 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55422ea 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.817 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542c72 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.817 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.817 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.854 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c3f 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.854 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab09 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.982 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5541f20 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.982 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 230 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33966 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:33.982 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:33.982 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:34.251 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542cc1 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.252 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.309 INFO:teuthology.orchestra.run.smithi142.stderr:kernel callstack: 2024-09-16T16:46:35.206 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:35.206 INFO:teuthology.orchestra.run.smithi142.stderr:Suppressions used: 2024-09-16T16:46:35.206 INFO:teuthology.orchestra.run.smithi142.stderr: count bytes template 2024-09-16T16:46:35.206 INFO:teuthology.orchestra.run.smithi142.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:35.207 INFO:teuthology.orchestra.run.smithi142.stderr:----------------------------------------------------- 2024-09-16T16:46:35.207 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-16T16:46:35.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:35.257 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:46:35.257 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:35.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:46:35.288 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:35.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:46:35.357 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:35.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:46:35.382 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:35.382 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:46:35.447 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:35.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T16:46:35.512 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:35.513 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:46:35.531 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:35.531 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T16:46:35.568 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:46:35.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDeYOhm/JK7LRAArcglPCyEkcH1YkUKVK1gIA== 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDhYOhmbnziLxAAK3kpOnCXAfodrcQDgscRag== 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDbYOhm0Ej6ORAAdgMUwljfhma7IB+P2RqHsA== 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDmYOhmsI9sFhAAxpyf3xv9FWQH5qVuHktRMQ== 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDpYOhm18CZFRAAvE+wK5mGaEjyp4LlD/yheg== 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-16T16:46:35.598 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDcYOhmTxSKARAAQ0F8Zx3vUTFVCzHldWQOUA== 2024-09-16T16:46:35.599 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-16T16:46:35.599 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDcYOhmo9dEBRAAaz+/UNNELCUiQUgmYgYrlw== 2024-09-16T16:46:35.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:46:35.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:35.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:36.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:36.083 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:46:36.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:36.107 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:36.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.411+0000 7f5fa851fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.411+0000 7f5fa851fc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:36.451 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:36.507 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:46:36.507 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:46:36.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:46:36.549 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:46:36.549 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:46:36.549 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:46:36.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:46:36.552 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:46:36.552 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:46:36.552 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:46:36.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:46:36.631 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-16T16:46:36.629+0000 7fd222a48c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.631 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-16T16:46:36.629+0000 7fd222a48c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.631 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-16T16:46:36.630+0000 7fd222a48c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.655 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-16T16:46:36.654+0000 7f167b821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.653+0000 7f9f3a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.664+0000 7f9f3a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.666 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-16T16:46:36.666+0000 7f167b821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.667 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-16T16:46:36.666+0000 7f167b821000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.736 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-16T16:46:36.748 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:46:36.748 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:46:36.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:46:36.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.846+0000 7fd226391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:36.854+0000 7fd226391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:36.933 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-09-16T16:46:36.932+0000 7fd21a9f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:46:36.933 INFO:tasks.ceph.mon.a.smithi103.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:46:36.934 INFO:tasks.ceph.mon.a.smithi103.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:46:36.934 INFO:tasks.ceph.mon.a.smithi103.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:46:36.934 INFO:tasks.ceph.mon.a.smithi103.stderr:feature with important data. 2024-09-16T16:46:36.934 INFO:tasks.ceph.mon.a.smithi103.stderr: 2024-09-16T16:46:37.750 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:46:37.751 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:37.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:46:37.777 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-16T16:46:37.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:46:37.844 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:37.844 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:46:37.869 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-16T16:46:37.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T16:46:37.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new addd4808-261e-4463-a41d-bd62072193ce 0 2024-09-16T16:46:38.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.076+0000 7ff101391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.085+0000 7ff101391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.165 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-09-16T16:46:38.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 2eeccfe6-e6d7-4e8b-8f33-e5c36deea048 1 2024-09-16T16:46:38.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.278+0000 7f84ddc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.288+0000 7f84ddc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.366 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-09-16T16:46:38.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 6ad824d5-21d6-45c5-bef3-5b19fd38ee78 2 2024-09-16T16:46:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.480+0000 7faa2f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.490+0000 7faa2f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.571 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-09-16T16:46:38.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 2d88a9d1-ef59-41fe-a72b-0c2abe5ae620 3 2024-09-16T16:46:38.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.684+0000 7f9ca9f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-16T16:46:38.694+0000 7f9ca9f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:38.771 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-09-16T16:46:38.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:38.820 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:46:38.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:38.862 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:46:38.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:38.894 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:46:38.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:38.937 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:46:38.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:38.967 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:46:38.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:39.009 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:46:39.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:39.043 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T16:46:39.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:39.085 INFO:tasks.ceph.osd.3:Started 2024-09-16T16:46:39.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:39.193+0000 7f8c97191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:39.201+0000 7f8c97191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.269 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:39.270 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T16:46:38.771010+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:39.282 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:46:39.282 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:46:39.685 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:39.789 INFO:teuthology.misc.health.smithi103.stderr:2024-09-16T16:46:39.784+0000 7f60a2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.793 INFO:teuthology.misc.health.smithi103.stderr:2024-09-16T16:46:39.792+0000 7f60a2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:39.863 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-16T16:46:39.863 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":7,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T16:46:38.771010+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:39.873 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T16:46:42.760 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-09-16T16:46:42.759+0000 7f1618fbd640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:46:46.277 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:46.389 INFO:teuthology.misc.health.smithi103.stderr:2024-09-16T16:46:46.385+0000 7fe4e4efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.393 INFO:teuthology.misc.health.smithi103.stderr:2024-09-16T16:46:46.393+0000 7fe4e4efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.579 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-16T16:46:46.579 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":11,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T16:46:45.813704+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:46.591 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T16:46:46.592 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:46:46.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:46:46.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:46.693+0000 7f70f5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:46.704+0000 7f70f5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.821 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'rbd' created 2024-09-16T16:46:47.841 DEBUG:teuthology.orchestra.run.smithi103:> rbd --cluster ceph pool init rbd 2024-09-16T16:46:47.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:47.954+0000 7f9ef1c43ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:47.954+0000 7f9ef1c43ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:47.959+0000 7f9ef1c43ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.890 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:46:50.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:46:50.891 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:46:51.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:50.997+0000 7f908887d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.006+0000 7f908887d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.191 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:51.204 INFO:teuthology.orchestra.run.smithi103.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:46:51.204 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:46:51.205 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:46:51.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:46:51.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:46:51.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.308+0000 7f4dd7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.315+0000 7f4dd7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:51.560 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":997997503},{"type":"v1","addr":"172.21.15.142:6801","nonce":997997503}]},"active_addr":"172.21.15.142:6801/997997503","active_change":"2024-09-16T16:46:41.745415+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1126385628}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3877914932}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1347669501}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":865849015}]}]} 2024-09-16T16:46:51.562 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:46:51.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:46:51.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:51.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.667+0000 7fb3eecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.675+0000 7fb3eecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.862 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:51.862 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T16:46:50.836151+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.898738+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:51.876 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:46:51.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:51.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.980+0000 7f2827674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:51.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:51.988+0000 7f2827674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:52.171 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T16:46:50.836151+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.898738+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:52.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:46:52.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:46:52.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:46:52.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T16:46:52.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.298+0000 7f976c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.298+0000 7fbba1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.298+0000 7f04d1511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.298+0000 7f32992d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.308+0000 7fbba1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.308+0000 7f04d1511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.309+0000 7f976c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.309+0000 7f32992d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.344 INFO:teuthology.orchestra.run.smithi103.stdout:42949672968 2024-09-16T16:46:52.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T16:46:52.347 INFO:teuthology.orchestra.run.smithi103.stdout:38654705673 2024-09-16T16:46:52.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:46:52.348 INFO:teuthology.orchestra.run.smithi103.stdout:42949672968 2024-09-16T16:46:52.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:46:52.350 INFO:teuthology.orchestra.run.smithi103.stdout:38654705673 2024-09-16T16:46:52.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:46:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.451+0000 7fc9fa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.461+0000 7fc9fa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.499+0000 7f31a48d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.500+0000 7fa23df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.508+0000 7f31a48d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.509+0000 7fa23df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.553+0000 7fd385791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.563+0000 7fd385791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.669 INFO:teuthology.orchestra.run.smithi103.stdout:42949672968 2024-09-16T16:46:52.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.3 2024-09-16T16:46:52.688 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.722 INFO:teuthology.orchestra.run.smithi103.stdout:42949672968 2024-09-16T16:46:52.722 INFO:teuthology.orchestra.run.smithi103.stdout:38654705673 2024-09-16T16:46:52.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2024-09-16T16:46:52.737 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2024-09-16T16:46:52.738 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.763 INFO:teuthology.orchestra.run.smithi103.stdout:38654705673 2024-09-16T16:46:52.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.1 2024-09-16T16:46:52.776 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:52.776 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:46:52.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:52.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.920+0000 7f4bd4911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:52.928+0000 7f4bd4911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.113 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:53.113 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:46:53.125 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:46:52.332382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:53.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:53.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.230+0000 7f8a0e148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.237+0000 7f8a0e148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.420 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:46:53.434 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T16:46:52.332382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:53.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:46:53.434 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:46:53.435 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:46:53.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:46:53.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.537+0000 7ff87b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.544+0000 7ff87b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.767 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:53.767 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:46:53.781 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:46:53.781 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-16T16:46:53.792 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T16:46:53.792 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}} 2024-09-16T16:46:53.792 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T16:46:53.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-16T16:46:53.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.898+0000 7fc127551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:53.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:53.909+0000 7fc127551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.113 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-16T16:46:54.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:46:54.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:54.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.217+0000 7f062da46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.225+0000 7f062da46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.407 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:54.408 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:46:54.420 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T16:46:53.756477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.424095"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:54.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:54.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.524+0000 7f6832591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.532+0000 7f6832591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:54.713 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:46:54.726 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T16:46:53.756477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.424095"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:54.726 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:46:54.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-16T16:46:54.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.830+0000 7fa55bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:54.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:54.839+0000 7fa55bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.028 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 16 2024-09-16T16:46:55.028 INFO:teuthology.orchestra.run.smithi103.stdout:fsid f25e6613-aa37-429e-93f8-21da834447fa 2024-09-16T16:46:55.028 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-16T16:46:36.654084+0000 2024-09-16T16:46:55.028 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-16T16:46:50.836151+0000 2024-09-16T16:46:55.028 INFO:teuthology.orchestra.run.smithi103.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:crush_version 4 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:full_ratio 0.95 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:backfillfull_ratio 0.9 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:nearfull_ratio 0.85 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:require_min_compat_client luminous 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:min_compat_client jewel 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:require_osd_release squid 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:stretch_mode_enabled false 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:allow_crimson=true 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-16T16:46:55.029 INFO:teuthology.orchestra.run.smithi103.stdout: removed_snaps_queue [2~1] 2024-09-16T16:46:55.030 INFO:teuthology.orchestra.run.smithi103.stdout:max_osd 4 2024-09-16T16:46:55.030 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6800/254186612 v2:172.21.15.103:6801/254186612 exists,up addd4808-261e-4463-a41d-bd62072193ce 2024-09-16T16:46:55.030 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6803/589375751 v2:172.21.15.103:6802/589375751 exists,up 2eeccfe6-e6d7-4e8b-8f33-e5c36deea048 2024-09-16T16:46:55.030 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.142:6804/2370785701 v2:172.21.15.142:6803/2370785701 exists,up 6ad824d5-21d6-45c5-bef3-5b19fd38ee78 2024-09-16T16:46:55.030 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.142:6805/800639534 v2:172.21.15.142:6806/800639534 exists,up 2d88a9d1-ef59-41fe-a72b-0c2abe5ae620 2024-09-16T16:46:55.041 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6800/254186612 v2:172.21.15.103:6801/254186612 exists,up addd4808-261e-4463-a41d-bd62072193ce', 'osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.103:6803/589375751 v2:172.21.15.103:6802/589375751 exists,up 2eeccfe6-e6d7-4e8b-8f33-e5c36deea048', 'osd.2 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.142:6804/2370785701 v2:172.21.15.142:6803/2370785701 exists,up 6ad824d5-21d6-45c5-bef3-5b19fd38ee78', 'osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.142:6805/800639534 v2:172.21.15.142:6806/800639534 exists,up 2d88a9d1-ef59-41fe-a72b-0c2abe5ae620'] 2024-09-16T16:46:55.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mon.a", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster": "ceph", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "admin_socket_mode": "", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_client_required": "cephx, none", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_cluster_required": "cephx", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_debug": "true", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-16T16:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_service_required": "cephx", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_supported": "cephx", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio": "true", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_poll_ms": "250", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_aio_reap_max": "16", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_async_discard_threads": "0", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_block_size": "4096", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio": "false", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_debug_inflight_ios": "false", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_enable_discard": "false", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_flock_retry": "3", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-16T16:46:55.149 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_inject_crash": "0", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring": "false", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring_hipri": "false", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bdev_type": "", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_alloc_size": "1048576", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_allocator": "hybrid", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_buffered_io": "true", 2024-09-16T16:46:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_for_zeros": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_compact_log_sync": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_max_log_runway": "4194304", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_max_prefetch": "1048576", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_min_flush_size": "524288", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_min_log_runway": "1048576", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_replay_recovery": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-16T16:46:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_sync_write": "false", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_allocation_from_file": "true", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_allocator": "hybrid", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_async_db_compaction": "true", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_multi": "true", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-16T16:46:55.152 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_create": "true", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_create": "false", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_path": "", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_db_size": "0", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_path": "", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_preallocate_file": "false", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_size": "107374182400", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_create": "false", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_path": "", 2024-09-16T16:46:55.153 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_block_wal_size": "100663296", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs": "true", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:46:55.154 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_autotune": "true", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size": "0", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_type": "2q", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_clone_cow": "true", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-16T16:46:55.155 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_mode": "none", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_csum_type": "crc32c", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_freelist": "false", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-16T16:46:55.156 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_small_allocations": "0", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_default_buffered_read": "true", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_default_buffered_write": "false", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-16T16:46:55.157 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fail_eio": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mount": "false", 2024-09-16T16:46:55.158 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_umount": "false", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_ignore_data_csum": "false", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-16T16:46:55.159 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_log_op_age": "5.000000", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_alloc_size": "0", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size": "0", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_max_deferred_txc": "32", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size": "0", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_nid_prealloc": "1024", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-16T16:46:55.160 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_retry_disk_reads": "3", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_cf": "true", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_spdk_mem": "512", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-16T16:46:55.161 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_tracing": "false", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-16T16:46:55.162 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_write_v2": "false", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_write_v2_random": "false", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_zero_block_detection": "false", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-16T16:46:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_cluster_require_signatures": "false", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_cluster_require_version": "2", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_require_signatures": "false", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_require_version": "2", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_service_require_signatures": "false", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_service_require_version": "2", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "cephx_sign_messages": "true", 2024-09-16T16:46:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "chdir": "", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_acl_type": "", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_asio_thread_count": "2", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_cache_mid": "0.750000", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_cache_size": "16384", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_caps_release_delay": "5", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_check_pool_perm": "true", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_force_sync_read": "false", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_getattr_caps": "false", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_inject_features": "", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_debug_inject_tick_delay": "0", 2024-09-16T16:46:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_die_on_failed_remount": "false", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_dirsize_rbytes": "true", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_force_lazyio": "false", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_fs": "", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_inject_release_failure": "false", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_max_inline_size": "4096", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mds_namespace": "", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_metadata": "", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_gid": "-1", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_timeout": "300", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mount_uid": "-1", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_mountpoint": "/", 2024-09-16T16:46:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_notify_timeout": "10", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc": "true", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_dirty": "104857600", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_max_objects": "1000", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_size": "209715200", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_oc_target_dirty": "8388608", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_permissions": "true", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_quota": "true", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_quota_df": "true", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_max_bytes": "0", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_max_periods": "4", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_readahead_min": "131072", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_reconnect_stale": "false", 2024-09-16T16:46:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "client_shutdown_timeout": "30", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_snapdir": ".snap", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_tick_interval": "1", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_trace": "", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_try_dentry_invalidate": "false", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_use_faked_inos": "false", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "client_use_random_mds": "false", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog": "false", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_graylog_port": "12201", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_monitors": "default=true", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog": "false", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "clog_to_syslog_level": "info", 2024-09-16T16:46:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_addr": "-", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_network": "", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_network_interface": "", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_isal": "false", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_level": "5", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zlib_winsize": "-15", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "compressor_zstd_level": "1", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_alien_op_num_threads": "6", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_osd_stat_interval": "0", 2024-09-16T16:46:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_seastar_cpu_cores": "", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "crimson_seastar_num_threads": "0", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location_hook": "", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location_hook_timeout": "10", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "daemonize": "false", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "daos_pool": "tank", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_alienstore": "0/5", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_allow_any_pool_priority": "false", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asok": "1/5", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asok_assert_abort": "false", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_asserts_on_shutdown": "true", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_auth": "20/20", 2024-09-16T16:46:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bdev": "1/3", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bluefs": "1/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_bluestore": "1/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_buffer": "0/1", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ceph_dedup": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ceph_exporter": "1/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cephfs_mirror": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cephsqlite": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_client": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_compressor": "1/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_context": "0/1", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crimson_interrupt": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crush": "1/1", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_crypto": "1/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_cyanstore": "0/5", 2024-09-16T16:46:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_deliberately_leak_memory": "false", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_disable_randomized_ping": "false", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_dpdk": "1/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_eventtrace": "1/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_filer": "0/1", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_filestore": "1/3", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_finisher": "1/1", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_fuse": "1/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_heartbeat_testing_span": "0", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_heartbeatmap": "1/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_javaclient": "1/5", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_journal": "1/3", 2024-09-16T16:46:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_journaler": "0/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_kstore": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_lockdep": "0/1", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mclock": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_balancer": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_locker": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_log": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_log_expire": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_migrator": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mds_quiesce": "3/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_memstore": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mgr": "2/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mgrc": "1/5", 2024-09-16T16:46:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_mon": "20/20", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_monc": "0/10", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_ms": "1/1", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_none": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objclass": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objectcacher": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_objecter": "0/1", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_optracker": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_osd": "1/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_paxos": "20/20", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_perfcounter": "1/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_prioritycache": "1/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rados": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_mirror": "0/5", 2024-09-16T16:46:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_pwl": "0/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rbd_replay": "0/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_refs": "0/0", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_reserver": "1/1", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_access": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_datacache": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_dbstore": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_flight": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_notification": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rgw_sync": "1/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_rocksdb": "4/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore": "0/5", 2024-09-16T16:46:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_backref": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_cache": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_cleaner": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_device": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_epm": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_journal": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_lba": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_odata": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_omap": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_onode": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_t": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_seastore_tm": "0/5", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_striper": "0/1", 2024-09-16T16:46:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_test": "0/5", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_throttle": "1/1", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_timer": "0/1", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_tp": "0/5", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "debug_trace": "1/5", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "device_failure_prediction_mode": "none", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_graylog": "false", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_journald": "false", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_stderr": "true", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "err_to_syslog": "false", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event_tracing": "false", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_addr": "0.0.0.0", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_cert_file": "", 2024-09-16T16:46:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_http_port": "9926", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_key_file": "", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_prio_limit": "5", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_sort_metrics": "true", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "exporter_stats_period": "5", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "fake_statfs_for_testing": "0", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "fatal_signal_handlers": "true", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filer_max_purge_ops": "10", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filer_max_truncate_ops": "128", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_apply_finisher_threads": "1", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_blackhole": "false", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_btrfs_clone_range": "true", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_btrfs_snap": "true", 2024-09-16T16:46:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_caller_concurrency": "10", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_collect_device_partition_information": "true", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_commit_timeout": "600.000000", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_inject_read_err": "false", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_omap_check": "false", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_debug_verify_split": "false", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_dump_file": "", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fadvise": "true", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fail_eio": "true", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fd_cache_shards": "16", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fd_cache_size": "128", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fiemap": "false", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fiemap_threshold": "4096", 2024-09-16T16:46:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_inject_stall": "0", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_parallel": "false", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_trailing": "false", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_journal_writeahead": "false", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_kill_at": "0", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs": "0", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-16T16:46:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size": "0", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_merge_threshold": "-10", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_odsync_write": "false", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_backend": "rocksdb", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_backend_path": "", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-16T16:46:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_thread_timeout": "60", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_op_threads": "2", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_punch_hole": "false", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_queue_max_ops": "50", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-16T16:46:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_seek_data_hole": "false", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_sloppy_crc": "false", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_splice": "false", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_split_multiple": "2", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_split_rand_factor": "20", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_update_to": "1000", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-16T16:46:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_enable": "true", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_xfs_extsize": "false", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "filestore_zfs_snap": "false", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "fio_dir": "/tmp/fio", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "f25e6613-aa37-429e-93f8-21da834447fa", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_allow_other": "true", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_atomic_o_trunc": "true", 2024-09-16T16:46:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_big_writes": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_debug": "false", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_default_permissions": "false", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_disable_pagecache": "false", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_max_write": "0", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_multithreaded": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_require_active_mds": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_set_user_groups": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_move": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_read": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_splice_write": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "fuse_use_invalidate_cb": "true", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-16T16:46:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "gss_target_name": "ceph", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_file": "", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_inject_failure": "0", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "heartbeat_interval": "5", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "host": "smithi103", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-16T16:46:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "inject_early_sigterm": "false", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "jaeger_agent_port": "6799", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "jaeger_tracing_enable": "false", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_aio": "true", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_align_min_size": "65536", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_block_align": "true", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_block_size": "4096", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_dio": "true", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_discard": "false", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_force_aio": "false", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_ignore_corruption": "false", 2024-09-16T16:46:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_max_write_bytes": "10485760", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_max_write_entries": "100", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_replay_from": "0", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_write_header_frequency": "0", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journal_zero_on_create": "false", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_prefetch_periods": "10", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_prezero_periods": "5", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "journaler_write_head_interval": "15", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "keyfile": "", 2024-09-16T16:46:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_backend": "rocksdb", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_default_stripe_size": "65536", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_fsck_on_mount": "false", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_max_bytes": "67108864", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_max_ops": "512", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_nid_prealloc": "1024", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_onode_map_size": "1024", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_sync_submit_transaction": "false", 2024-09-16T16:46:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kstore_sync_transaction": "false", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "librados_thread_count": "2", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "lockdep": "false", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "lockdep_force_backtrace": "false", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_coarse_timestamps": "true", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_flush_on_exit": "false", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_graylog_host": "127.0.0.1", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_graylog_port": "12201", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_max_new": "1000", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_max_recent": "10000", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_stderr_prefix": "", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_stop_at_utilization": "0.970000", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": "true", 2024-09-16T16:46:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_graylog": "false", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_journald": "false", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_stderr": "false", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_syslog": "false", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max_rotating_auth_attempts": "10", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_action_on_write_error": "1", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_alternate_name_max": "8192", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_asio_thread_count": "2", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_export_pin": "true", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_dirs": "true", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_interval": "5", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-16T16:46:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_interval": "10", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_max": "-1", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_max_until": "-1", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_merge_size": "50", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_midchunk": "0.300000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_min_start": "0.200000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_minchunk": "0.001000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_mode": "0", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_need_max": "1.200000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_need_min": "0.800000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_overload_epochs": "2", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_bits": "3", 2024-09-16T16:46:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_size": "10000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_target_decay": "10.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_grace": "15.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_interval": "4.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_mid": "0.700000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_delay": "0", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_release_free_interval": "10", 2024-09-16T16:46:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_reservation": "0.050000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_interval": "1", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache_trim_threshold": "262144", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_prealloc_inos": "1000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_connect_bootstrapping": "false", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_damage_table_max_entries": "10000", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_auth_pins": "false", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_frag": "false", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_scatterstat": "false", 2024-09-16T16:46:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_debug_subtrees": "false", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_decay_halflife": "5.000000", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_default_dir_hash": "2", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_defer_session_stale": "true", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_deny_all_reconnect": "false", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_keys_per_op": "16384", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_max_commit_size": "10", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_max_entries": "0", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dir_prefetch": "true", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_on_map": "false", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_early_reply": "true", 2024-09-16T16:46:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_enable_op_tracker": "true", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_enforce_unique_name": "true", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_random": "true", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_health_summarize_threshold": "10", 2024-09-16T16:46:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_health_dummy": "false", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_migrator_session_race": "false", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_join_fs": "", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_journal_format": "1", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_create_at": "0", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_dirfrag_at": "0", 2024-09-16T16:46:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_export_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_import_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_expire_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_journal_replay_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_link_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_mdstable_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_openc_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_rename_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_kill_shutdown_at": "0", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_event_large_threshold": "524288", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_events_per_segment": "1024", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_max_events": "-1", 2024-09-16T16:46:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_max_segments": "128", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_pause": "false", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_segment_size": "0", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_threshold": "128", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log_warn_factor": "2.000000", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_caps_per_client": "1048576", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_completed_flushes": "100000", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_completed_requests": "100000", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_export_size": "20971520", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_file_recover": "32", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_files": "64", 2024-09-16T16:46:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_ops": "8192", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_max_snaps_per_dir": "100", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_metrics_update_interval": "2", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_min_caps_per_client": "100", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_min_caps_working_set": "10000", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_numa_node": "-1", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_complaint_time": "30.000000", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_duration": "600", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_size": "20", 2024-09-16T16:46:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_slow_op_size": "20", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_op_log_threshold": "5", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_ping_grace": "15", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_ping_interval": "5", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_caps": "30000", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_recall_warning_threshold": "262144", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-16T16:46:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_replay_interval": "1.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_root_ino_gid": "0", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_root_ino_uid": "0", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_scrub_stats_review_period": "1", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-16T16:46:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_shutdown_check": "0", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_skip_ino": "0", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_max_uid": "4294967294", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_min_uid": "0", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_snap_rstat": "false", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_standby_replay_damaged": "false", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_symlink_recovery": "true", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_thrash_exports": "0", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_thrash_fragments": "0", 2024-09-16T16:46:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_tick_interval": "5.000000", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_valgrind_exit": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_verify_backtrace": "1", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_verify_scatter": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_wipe_sessions": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool_debug": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_device_bytes": "1073741824", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_page_set": "false", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "memstore_page_size": "65536", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_bytes": "134217728", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_messages": "512", 2024-09-16T16:46:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_disabled_modules": "", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_enable_op_tracker": "true", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_max_pg_creating": "1024", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_max_pg_num_change": "128", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mds_bytes": "134217728", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mds_messages": "128", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mon_bytes": "134217728", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_mon_messages": "128", 2024-09-16T16:46:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_duration": "600", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_size": "20", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_op_log_threshold": "5", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_osd_bytes": "536870912", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_osd_messages": "8192", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_pool": "true", 2024-09-16T16:46:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_standby_modules": "true", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_stats_period": "5", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_stats_threshold": "5", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_tick_period": "2", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_allow_pool_delete": "true", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_allow_pool_size_one": "true", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_auth_validate_all_caps": "true", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_bytes": "104857600", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_directed_command_retry": "2", 2024-09-16T16:46:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_hunt_parallel": "3", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_log_interval": "1.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_ping_interval": "10.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_client_target_rank": "-1", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_level": "debug", 2024-09-16T16:46:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_file": "true", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_journald": "false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_bootstrap": "false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_start": "false", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_compact_on_trim": "true", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-16T16:46:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_cpu_threads": "4", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_crush_min_required_version": "hammer", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_daemon_bytes": "419430400", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_avail_crit": "5", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_avail_warn": "5", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_data_size_warn": "16106127360", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_json": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_dump_transactions": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_extra_checks": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-16T16:46:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_reef": "false", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_no_require_squid": "false", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_down_mkfs_grace": "120", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_down_uptime_grace": "60", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_election_default_strategy": "1", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_election_timeout": "5.000000", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ping_divisor": "2", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_enable_op_tracker": "true", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_fake_pool_delete": "false", 2024-09-16T16:46:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_force_quorum_join": "false", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_globalid_prealloc": "10000", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_detail_to_clog": "false", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_log_update_period": "5", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_max_detail": "50", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog": "true", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog_interval": "600", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_host": "172.21.15.103", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_host_override": "", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_initial_members": "", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-16T16:46:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease": "5.000000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_full_interval": "50", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_max": "10000", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_log_max_summary": "50", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_log_epochs": "500", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-16T16:46:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_osd": "10000", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_pg_per_osd": "10000", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_pool_pg_num": "65536", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_force_trim_to": "0", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mds_skip_sanity": "false", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_memory_autotune": "true", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_memory_target": "2147483648", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_beacon_grace": "30", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_digest_period": "5", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_inactive_grace": "60", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-16T16:46:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_min_osdmap_epochs": "50", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_complaint_time": "30", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_duration": "600", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_size": "20", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_slow_op_size": "20", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_op_log_threshold": "5", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_in": "false", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-16T16:46:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_cache_size": "500", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_down_out_interval": "600", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_force_trim_to": "0", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-16T16:46:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_down_reporters": "2", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_report_timeout": "900", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-16T16:46:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_stuck_threshold": "60", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_probe_timeout": "2.000000", 2024-09-16T16:46:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_max_change": "0.050000", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_max_osds": "4", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_interval": "86400", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_max_keys": "100", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_scrub_timeout": "300", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_session_timeout": "300", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_smart_report_timeout": "5", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stat_smooth_intervals": "6", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-16T16:46:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_pool_min_size": "2", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_pool_size": "4", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_debug": "false", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_provider_kill_at": "0", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_requester_kill_at": "0", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_sync_timeout": "60.000000", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_target_pg_per_osd": "100", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_tick_interval": "5", 2024-09-16T16:46:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_timecheck_interval": "300.000000", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_use_min_delay_socket": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_older_version_delay": "604800", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_misplaced": "false", 2024-09-16T16:46:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_older_version": "true", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": "", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-16T16:46:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "motr_tracing_enabled": "false", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_op_threads": "3", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_cm": "false", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_device_name": "", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_dscp": "96", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_local_gid": "", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_port_num": "1", 2024-09-16T16:46:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_sl": "3", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_support_srq": "true", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_rdma_type": "ib", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_async_reap_threshold": "5", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_before_connect": "false", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_ipv4": "true", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_ipv6": "false", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_msgr1": "true", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_msgr2": "true", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_port_max": "7568", 2024-09-16T16:46:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_port_min": "6800", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_retry_count": "3", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_bind_retry_delay": "5", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_client": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mds": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mgr": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_mon": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_blackhole_osd": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_client_mode": "crc", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_cluster_mode": "crc", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_cluster_type": "", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_compress_secure": "false", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_connection_idle_timeout": "900", 2024-09-16T16:46:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_connection_ready_timeout": "10", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_crc_data": "true", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_crc_header": "true", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_bad_msg": "false", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_bug": "true", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_old_message": "true", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_skipped_message": "false", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_coremask": "0xF", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_enable_tso": "true", 2024-09-16T16:46:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hugepages": "", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_lro": "true", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_memory_channel": "4", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_pmd": "", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_port_id": "0", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_dump_on_send": "false", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_initial_backoff": "0.200000", 2024-09-16T16:46:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_max": "1.000000", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_delay_type": "", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_network_congestion": "0", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_inject_socket_failures": "0", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_learn_addr_from_peer": "true", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_accept_failures": "4", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_max_backoff": "15.000000", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_client_mode": "crc", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_cluster_mode": "crc", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_mon_service_mode": "crc", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compress_min_size": "1024", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compress_mode": "none", 2024-09-16T16:46:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_pq_min_cost": "65536", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_public_type": "", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_service_mode": "crc", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_listen_backlog": "512", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_nodelay": "true", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_tcp_rcvbuf": "0", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "ms_type": "async+posix", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "no_config_file": "false", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_completion_locks_per_session": "32", 2024-09-16T16:46:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inflight_ops": "1024", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_tick_interval": "5.000000", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter_timeout": "10.000000", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objectstore_blackhole": "false", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "openssl_engine_opts": "", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_delay_time": "5.000000", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_hist_halflife": "1000", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_max_low_ops": "2", 2024-09-16T16:46:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_max_ops": "4", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_agent_slop": "0.020000", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_asio_thread_count": "2", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_async_recovery_min_cost": "100", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_scan_max": "512", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backfill_scan_min": "64", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_degraded": "false", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_peering": "false", 2024-09-16T16:46:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_backoff_on_unfound": "true", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_beacon_report_interval": "300", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_duration": "30", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_max_block_size": "67108864", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_blkin_trace_all": "false", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_check_for_log_corruption": "false", 2024-09-16T16:46:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_class_update_on_start": "true", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_message_cap": "256", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_message_size_cap": "524288000", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_op_priority": "63", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_client_watch_timeout": "30", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_command_max_records": "256", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_compact_on_start": "false", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-16T16:46:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_update_on_start": "true", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_crush_update_weight_set": "true", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_feed_pullee": "-1", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-16T16:46:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_misdirected_ops": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_no_acting_change": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_no_purge_strays": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_op_order": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_shutdown": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_trim_objects": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-16T16:46:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_snaps": "false", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_keys": "1024", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_stride": "524288", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_default_notify_timeout": "30", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep": "0.000000", 2024-09-16T16:46:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_discard_disconnected_ops": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_ec_partial_reads": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_enable_op_tracker": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_info": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-16T16:46:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_function_tracing": "false", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_grace": "20", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_interval": "6", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_peers": "10", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_min_size": "2000", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_stale": "600", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_max_size": "100000", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_min_size": "1000", 2024-09-16T16:46:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_journal_size": "5120", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_kill_backfill_at": "0", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_cache_size": "50", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_dedup": "true", 2024-09-16T16:46:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_message_max": "40", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_map_share_max_epochs": "40", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_attr_name_len": "100", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_attr_size": "0", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_backfills": "1", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_markdown_count": "5", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_markdown_period": "600", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_name_len": "2048", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_namespace_len": "256", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_object_size": "134217728", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-16T16:46:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_blocked_by": "16", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_log_entries": "10000", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_pgls": "1024", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_push_cost": "8388608", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_push_objects": "10", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_scrubs": "3", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_trimming_pgs": "2", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_write_op_reply_len": "64", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_max_write_size": "90", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-16T16:46:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_profile": "balanced", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-16T16:46:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_base": "805306368", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_cache_min": "134217728", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target": "4294967296", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target_autotune": "false", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_min_pg_log_entries": "250", 2024-09-16T16:46:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_min_recovery_priority": "0", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_report_interval": "5", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_num_cache_shards": "32", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_num_op_tracker_shard": "32", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_auto_affinity": "true", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_node": "-1", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_numa_prefer_iface": "true", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objecter_finishers": "1", 2024-09-16T16:46:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore": "bluestore", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_fuse": "false", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_objectstore_tracing": "false", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_complaint_time": "30.000000", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_duration": "600", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_size": "20", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_slow_op_size": "20", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_log_threshold": "5", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards": "0", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards_hdd": "5", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_shards_ssd": "8", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-16T16:46:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_pq_min_cost": "65536", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_queue_cut_off": "high", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_op_thread_timeout": "15", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_open_classes_on_start": "true", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_os_flags": "0", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_peering_op_priority": "255", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_delete_cost": "1048576", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_delete_priority": "5", 2024-09-16T16:46:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_trim_max": "10000", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_log_trim_min": "100", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-16T16:46:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_crimson": "true", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_flags": "0", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-16T16:46:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_min_size": "2", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pg_num": "32", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_pgp_num": "0", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_read_ratio": "70", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_size": "3", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_default_type": "replicated", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_push_per_object_cost": "1000", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recover_clone_overlap": "true", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-16T16:46:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_cost": "20971520", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active": "0", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_max_single_start": "1", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_op_priority": "3", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_priority": "5", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-16T16:46:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep": "0.000000", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_repair_during_recovery": "false", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_requested_scrub_priority": "120", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_auto_repair": "false", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_begin_hour": "0", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_begin_week_day": "0", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_chunk_max": "25", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_chunk_min": "5", 2024-09-16T16:46:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_cost": "52428800", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_during_recovery": "false", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_end_hour": "0", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_end_week_day": "0", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_event_cost": "4096", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_invalid_stats": "true", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_max_preemptions": "5", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-16T16:46:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_priority": "5", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_delay": "30", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_retry_trimming": "10", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_scrub_sleep": "0.000000", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_skip_data_digest": "false", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_smart_report_timeout": "5", 2024-09-16T16:46:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_cost": "1048576", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_priority": "5", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_target_transaction_size": "30", 2024-09-16T16:46:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_tracing": "false", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_use_stale_snap": "false", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osdc_blkin_trace_all": "false", 2024-09-16T16:46:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_kill_at": "0", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_max_join_drift": "10", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_min": "500", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_min_wait": "0.050000", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_propose_interval": "1.000000", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_max": "500", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_service_trim_min": "10", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_stash_full_interval": "25", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_trim_max": "500", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "paxos_trim_min": "250", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "perf": "true", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-16T16:46:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "-", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrv": "", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_bind_addr": "-", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_network": "", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_network_interface": "", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_busy_polling": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_enabled": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "qat_compressor_session_max_number": "256", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_mon_op_timeout": "0", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_osd_op_timeout": "0", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rados_tracing": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_atime_update_interval": "60", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_balance_parent_reads": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_balance_snap_reads": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blkin_trace_all": "false", 2024-09-16T16:46:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache": "true", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_policy": "writearound", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_size": "33554432", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_clone_copy_on_read": "false", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_compression_hint": "none", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_concurrent_management_ops": "10", 2024-09-16T16:46:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_clone_format": "auto", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_data_pool": "", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_features": "61", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_format": "2", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_map_options": "", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_order": "22", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_pool": "rbd", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_stripe_count": "0", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_default_stripe_unit": "0", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_enable_alloc_hint": "true", 2024-09-16T16:46:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_io_scheduler": "simple", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_order": "24", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_pool": "", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_journal_splay_width": "4", 2024-09-16T16:46:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_localize_parent_reads": "false", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_localize_snap_reads": "false", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-16T16:46:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-16T16:46:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_mtime_update_interval": "60", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_non_blocking_aio": "true", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_op_thread_timeout": "60", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_op_threads": "1", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_parent_cache_enabled": "false", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-16T16:46:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_plugins": "", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_burst": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_bps_limit": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_exclude_ops": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_burst": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_iops_limit": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-16T16:46:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_read_from_replica_policy": "default", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_skip_partial_discard": "true", 2024-09-16T16:46:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_tracing": "false", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_validate_names": "true", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_validate_pool": "true", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "restapi_base_url": "", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "restapi_log_level": "", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_acl_grants_max_num": "100", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_admin_entry": "admin", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_asio_assert_yielding": "false", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_backend_store": "rados", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_barbican_url": "", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_beast_enable_async": "true", 2024-09-16T16:46:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_counters_cache": "false", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_enabled": "true", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_expiry_interval": "900", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cache_lru_size": "25000", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_config_store": "rados", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_content_length_compat": "false", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_copy_obj_progress": "true", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-16T16:46:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cors_rules_max_num": "100", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_cross_domain_policy": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_addr": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_password": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_kmip_username": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_require_ssl": "true", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-16T16:46:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_addr": "", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_auth": "token", 2024-09-16T16:46:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_namespace": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_prefix": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_token_file": "", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_buffersize": "524288", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_low_speed_time": "300", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-16T16:46:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-16T16:46:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_changes_size": "1000", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_num_shards": "128", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_log_window": "30", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-16T16:46:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_disable_s3select": "false", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-16T16:46:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dns_name": "", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dns_s3website_name": "", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_gc_threads": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_lc_threads": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_mdsearch": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_ops_log": "false", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_quota_threads": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_static_website": "false", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enable_usage_log": "false", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_enforce_swift_acls": "true", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_exit_timeout_secs": "120", 2024-09-16T16:46:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_expose_bucket": "false", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_extended_http_attrs": "", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_filter": "none", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_frontends": "beast port=7480", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_deferred": "50", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_objs": "32", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_gc_processor_period": "3600", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-16T16:46:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_init_timeout": "300", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_connection_idle": "300", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_domain": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_password": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_password_path": "", 2024-09-16T16:46:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_project": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_tenant": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_token": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_token_path": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_admin_user": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_domain": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_password": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_project": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_barbican_user": "", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-16T16:46:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_url": "", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_debug_interval": "-1", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_lock_max_time": "90", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_objs": "32", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_rules": "1000", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_worker": "3", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lc_thread_delay": "0", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_dnattr": "uid", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_searchfilter": "", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-16T16:46:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ldap_uri": "", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_http_headers": "", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_log_object_name_utc": "false", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attr_name_len": "0", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attr_size": "0", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_chunk_size": "4194304", 2024-09-16T16:46:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_listing_results": "5000", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_notify_retries": "10", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_put_param_size": "1048576", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_put_size": "5368709120", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_max_slo_entries": "1000", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_md_log_max_shards": "64", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_mp_lock_max_time": "600", 2024-09-16T16:46:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_max_gc": "300", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-16T16:46:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_num_async_rados_threads": "32", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_num_control_oids": "8", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_numa_node": "-1", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_chunk_size": "100", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_gc_interval": "600", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_thread_timeout": "600", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_op_tracing": "false", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_token": "", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_url": "", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_opa_verify_ssl": "true", 2024-09-16T16:46:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_rados": "false", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_ops_log_socket_path": "", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_push_interval": "2.000000", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_lanes": "3", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_cache_partitions": "3", 2024-09-16T16:46:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_print_continue": "true", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rados_tracing": "false", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm": "", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm_id": "", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_region": "", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-16T16:46:55.284 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_request_uri": "", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_batch_size": "64", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_max_aio": "128", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_num_logs": "16", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshard_thread_interval": "600", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_resolve_cname": "false", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_run_sync_thread": "true", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-16T16:46:55.285 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_scheduler_type": "throttler", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_script_uri": "", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_service_provider_name": "", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_client_id": "", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_client_secret": "", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_entry": "sts", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_key": "sts", 2024-09-16T16:46:55.286 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_min_session_duration": "900", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sts_token_introspection_url": "", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_account_in_url": "false", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_auth_entry": "auth", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_auth_url": "", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_custom_header": "", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_need_stats": "true", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_tenant_name": "", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_token_expiration": "86400", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_url": "", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_url_prefix": "swift", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-16T16:46:55.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_lease_period": "120", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_thread_pool_size": "512", 2024-09-16T16:46:55.288 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_comment": "", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_createby": "", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_encoding": "", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_flag": "false", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_origin": "", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_torrent_tracker": "", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_trust_forwarded_https": "false", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-16T16:46:55.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_max_shards": "32", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_usage_max_user_shards": "1", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_use_opa_authz": "false", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_counters_cache": "false", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_max_buckets": "1000", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_policies_max_num": "100", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_user_unique_email": "true", 2024-09-16T16:46:55.290 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_verify_ssl": "true", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone": "", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone_id": "", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup": "", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup_id": "", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgwlc_auto_session_clear": "true", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_block_size": "4096", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-16T16:46:55.291 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_size": "536870912", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_index_type": "binary_search", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_partition_filters": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_perf": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-16T16:46:55.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "run_dir": "/var/run/ceph", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_block_create": "true", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_cache_lru_size": "67108864", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_default_max_object_size": "16777216", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_device_size": "53687091200", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_full_integrity_check": "false", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_capacity": "16", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-16T16:46:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_main_device_type": "SSD", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "seastore_segment_size": "67108864", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "set_keepcaps": "false", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "setgroup": "", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "setuser": "", 2024-09-16T16:46:55.294 INFO:teuthology.orchestra.run.smithi103.stdout: "setuser_match_path": "", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "thp": "false", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "threadpool_default_timeout": "60", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "throttler_perf_counter": "true", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tmp_dir": "/tmp", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "uadk_compressor_enabled": "false", 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-16T16:46:55.295 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-16T16:46:55.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-16T16:46:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.401+0000 7f8619f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.407+0000 7f8619f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.421 INFO:teuthology.orchestra.run.smithi103.stdout:{} 2024-09-16T16:46:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T16:46:55.432 DEBUG:teuthology.orchestra.run.smithi103:> type ceph-objectstore-tool 2024-09-16T16:46:55.446 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T16:46:55.446 DEBUG:teuthology.orchestra.run.smithi142:> type ceph-objectstore-tool 2024-09-16T16:46:55.464 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T16:46:55.465 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T16:46:55.473 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:46:55.475 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:46:55.475 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-16T16:46:55.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-16T16:46:55.475 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-16T16:46:55.475 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:46:55.475 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:46:55.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:46:55.476 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-16T16:46:55.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:46:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.595+0000 7fba96711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.596+0000 7f439e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.602+0000 7fba96711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.596+0000 7f6175511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.605+0000 7f439e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:55.609+0000 7f6175511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:46:55.804 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:46:55.816 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-16T16:46:55.756935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.424553"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:46:56.102 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_0' created 2024-09-16T16:46:56.121 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-16T16:46:56.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:56.250+0000 7f11a5d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:56.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:56.263+0000 7f11a5d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:57.103 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-16T16:46:57.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:46:57.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:57.833+0000 7f8ab5efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:57.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:46:57.839+0000 7f8ab5efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:58.122 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-16T16:46:58.124 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:46:58.125 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:46:58.192 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-16T16:46:58.192 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:46:58.192 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_29551 2024-09-16T16:46:58.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:46:58.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:46:59.192 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 113 97 6.06215 6.0625 0.132802 0.147923 2024-09-16T16:46:59.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:00.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:00.068+0000 7f218bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:00.076+0000 7f218bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:00.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 226 210 6.56197 7.0625 0.0948079 0.147355 2024-09-16T16:47:00.818 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:00.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:47:00.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:00.955+0000 7f1cb1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:00.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:00.973+0000 7f1cb1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 340 324 6.74942 7.125 0.122617 0.144307 2024-09-16T16:47:02.130 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:47:02.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:47:02.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 461 445 6.95249 7.5625 0.224177 0.141266 2024-09-16T16:47:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:02.300+0000 7f52ff0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:02.313+0000 7f52ff0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:02.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:02.535+0000 7fa970ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:02.546+0000 7fa970ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.130 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:47:03.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:47:03.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 582 566 7.07435 7.5625 0.0705582 0.138935 2024-09-16T16:47:03.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:03.298+0000 7fdc51391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:03.316+0000 7fdc51391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.141 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:47:04.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:47:04.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 716 700 7.291 8.375 0.0843002 0.135514 2024-09-16T16:47:04.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:04.313+0000 7f927de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:04.327+0000 7f927de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:05.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.045+0000 7f2f0cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.052+0000 7f2f0cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.141 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:47:05.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:47:05.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:05.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 833 817 7.29385 7.3125 0.0733664 0.135465 2024-09-16T16:47:05.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.334+0000 7f91d8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.349+0000 7f91d8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:05.686 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-16T16:47:05.142581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.384549"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:05.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:05.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.869+0000 7fbee6c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:05.881+0000 7fbee6c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:06.149 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:06.170 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T16:47:05.759437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000938"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:06.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:47:06.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 949 933 7.28828 7.25 0.103312 0.135534 2024-09-16T16:47:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:06.320+0000 7f89a1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:06.331+0000 7f89a1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.829 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:06.829 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":23,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":5234688,"bytes_avail":214206259200,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T16:46:36.655894+0000","services":{}},"progress_events":{}} 2024-09-16T16:47:06.849 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:47:06.849 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:07.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:07.051+0000 7f1b7567d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:07.063+0000 7f1b7567d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 1071 1055 7.32562 7.625 0.136223 0.135044 2024-09-16T16:47:07.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:07.439 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:07.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:07.458 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T16:47:05.759437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000938"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:07.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:07.634+0000 7f9bc60c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:07.644+0000 7f9bc60c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:08.193 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 1211 1195 7.46797 8.75 0.224389 0.132771 2024-09-16T16:47:09.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 1344 1328 7.54468 8.3125 0.100715 0.130974 2024-09-16T16:47:10.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:10.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1481 1465 7.62943 8.5625 0.118021 0.130134 2024-09-16T16:47:10.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:10.250+0000 7f205a68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:10.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:10.259+0000 7f205a68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:10.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:10.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:10.622+0000 7f82b9688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:10.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:10.641+0000 7f82b9688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:10.997 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:10.998 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:11.017 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-16T16:47:09.760340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.628543"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:11.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:47:11.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:11.141+0000 7f9dfc2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:11.152+0000 7f9dfc2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1618 1602 7.70115 8.5625 0.101203 0.129018 2024-09-16T16:47:11.602 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:11.602 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":34,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":23,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":5234688,"bytes_avail":214206259200,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T16:46:36.655894+0000","services":{}},"progress_events":{}} 2024-09-16T16:47:11.624 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:47:11.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:11.782+0000 7f8b17111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:11.793+0000 7f8b17111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:12.080 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:12.080 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:12.101 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-16T16:47:11.760793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001826"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:12.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1747 1731 7.72691 8.0625 0.0442317 0.128487 2024-09-16T16:47:12.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:12.816+0000 7f2f27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:12.823+0000 7f2f27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:13.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1876 1860 7.74923 8.0625 0.0662541 0.12839 2024-09-16T16:47:14.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 2005 1989 7.76877 8.0625 0.0439922 0.127981 2024-09-16T16:47:15.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:15.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:15.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 2147 2131 7.8338 8.875 0.103626 0.127124 2024-09-16T16:47:15.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.258+0000 7fca36263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.273+0000 7fca36263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.287+0000 7fc899311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.295+0000 7fc899311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.571 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:15.572 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:15.594 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-16T16:47:13.761238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5112,"kb_used_data":5112,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185800,"statfs":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.619189"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":88,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.855700+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:46:50.855700+0000","last_peered":"2024-09-16T16:46:50.855700+0000","last_clean":"2024-09-16T16:46:50.855700+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:46:50.855700+0000","last_undegraded":"2024-09-16T16:46:50.855700+0000","last_fullsized":"2024-09-16T16:46:50.855700+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863307+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:46:50.863307+0000","last_peered":"2024-09-16T16:46:50.863307+0000","last_clean":"2024-09-16T16:46:50.863307+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:46:50.863307+0000","last_undegraded":"2024-09-16T16:46:50.863307+0000","last_fullsized":"2024-09-16T16:46:50.863307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.861174+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:46:50.861174+0000","last_peered":"2024-09-16T16:46:50.861174+0000","last_clean":"2024-09-16T16:46:50.861174+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:46:50.861174+0000","last_undegraded":"2024-09-16T16:46:50.861174+0000","last_fullsized":"2024-09-16T16:46:50.861174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858506+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:46:50.858506+0000","last_peered":"2024-09-16T16:46:50.858506+0000","last_clean":"2024-09-16T16:46:50.858506+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:46:50.858506+0000","last_undegraded":"2024-09-16T16:46:50.858506+0000","last_fullsized":"2024-09-16T16:46:50.858506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.864627+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:46:50.864627+0000","last_peered":"2024-09-16T16:46:50.864627+0000","last_clean":"2024-09-16T16:46:50.864627+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:46:50.864627+0000","last_undegraded":"2024-09-16T16:46:50.864627+0000","last_fullsized":"2024-09-16T16:46:50.864627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.858392+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:46:50.858392+0000","last_peered":"2024-09-16T16:46:50.858392+0000","last_clean":"2024-09-16T16:46:50.858392+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:46:50.858392+0000","last_undegraded":"2024-09-16T16:46:50.858392+0000","last_fullsized":"2024-09-16T16:46:50.858392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.857888+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:46:50.857888+0000","last_peered":"2024-09-16T16:46:50.857888+0000","last_clean":"2024-09-16T16:46:50.857888+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:46:50.857888+0000","last_undegraded":"2024-09-16T16:46:50.857888+0000","last_fullsized":"2024-09-16T16:46:50.857888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.859034+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:46:50.859034+0000","last_peered":"2024-09-16T16:46:50.859034+0000","last_clean":"2024-09-16T16:46:50.859034+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:46:50.859034+0000","last_undegraded":"2024-09-16T16:46:50.859034+0000","last_fullsized":"2024-09-16T16:46:50.859034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:46:56.099414+0000","last_change":"2024-09-16T16:46:56.099414+0000","last_active":"2024-09-16T16:46:56.099414+0000","last_peered":"2024-09-16T16:46:56.099414+0000","last_clean":"2024-09-16T16:46:56.099414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:46:56.099414+0000","last_undegraded":"2024-09-16T16:46:56.099414+0000","last_fullsized":"2024-09-16T16:46:56.099414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T16:46:50.863468+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:46:50.863468+0000","last_peered":"2024-09-16T16:46:50.863468+0000","last_clean":"2024-09-16T16:46:50.863468+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:46:50.863468+0000","last_undegraded":"2024-09-16T16:46:50.863468+0000","last_fullsized":"2024-09-16T16:46:50.863468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206259200,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1244,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296484,"statfs":{"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1632,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296096,"statfs":{"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":668,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297060,"statfs":{"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1568,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296160,"statfs":{"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551267840,"internally_reserved":0,"allocated":1605632,"data_stored":1605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552189440,"internally_reserved":0,"allocated":684032,"data_stored":684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551202304,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551599616,"internally_reserved":0,"allocated":1273856,"data_stored":1273856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:15.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:47:15.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.756+0000 7fae2c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:15.765+0000 7fae2c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:16.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 2277 2261 7.84992 8.125 0.0869158 0.126632 2024-09-16T16:47:16.206 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:16.206 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":39,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":23,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":25}],"num_pgs":25,"num_pools":3,"num_objects":1964,"data_bytes":129040947,"bytes_used":729489408,"bytes_avail":213482004480,"bytes_total":214211493888,"write_bytes_sec":12096175,"read_op_per_sec":0,"write_op_per_sec":184},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T16:46:36.655894+0000","services":{}},"progress_events":{}} 2024-09-16T16:47:16.225 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:47:16.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:16.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:16.394+0000 7f95a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:16.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:16.407+0000 7f95a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:16.672 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:16.672 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:16.688 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-16T16:47:15.761687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129040947,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2041,"num_write_kb":126548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2015,"ondisk_log_size":2015,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":712392,"kb_used_data":712392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208478520,"statfs":{"total":214211493888,"available":213482004480,"internally_reserved":0,"allocated":729489408,"data_stored":729489408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.619105"},"pg_stats":[{"pgid":"3.f","version":"23'115","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.649421+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:13.649421+0000","last_peered":"2024-09-16T16:47:13.649421+0000","last_clean":"2024-09-16T16:47:13.649421+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:13.649421+0000","last_undegraded":"2024-09-16T16:47:13.649421+0000","last_fullsized":"2024-09-16T16:47:13.649421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.845572+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:13.845572+0000","last_peered":"2024-09-16T16:47:13.845572+0000","last_clean":"2024-09-16T16:47:13.845572+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:13.845572+0000","last_undegraded":"2024-09-16T16:47:13.845572+0000","last_fullsized":"2024-09-16T16:47:13.845572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'126","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.492207+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:13.492207+0000","last_peered":"2024-09-16T16:47:13.492207+0000","last_clean":"2024-09-16T16:47:13.492207+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:13.492207+0000","last_undegraded":"2024-09-16T16:47:13.492207+0000","last_fullsized":"2024-09-16T16:47:13.492207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.377346+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:13.377346+0000","last_peered":"2024-09-16T16:47:13.377346+0000","last_clean":"2024-09-16T16:47:13.377346+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:13.377346+0000","last_undegraded":"2024-09-16T16:47:13.377346+0000","last_fullsized":"2024-09-16T16:47:13.377346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.786323+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:13.786323+0000","last_peered":"2024-09-16T16:47:13.786323+0000","last_clean":"2024-09-16T16:47:13.786323+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:13.786323+0000","last_undegraded":"2024-09-16T16:47:13.786323+0000","last_fullsized":"2024-09-16T16:47:13.786323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.557256+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:13.557256+0000","last_peered":"2024-09-16T16:47:13.557256+0000","last_clean":"2024-09-16T16:47:13.557256+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:13.557256+0000","last_undegraded":"2024-09-16T16:47:13.557256+0000","last_fullsized":"2024-09-16T16:47:13.557256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'118","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.563589+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:13.563589+0000","last_peered":"2024-09-16T16:47:13.563589+0000","last_clean":"2024-09-16T16:47:13.563589+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:13.563589+0000","last_undegraded":"2024-09-16T16:47:13.563589+0000","last_fullsized":"2024-09-16T16:47:13.563589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'134","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.674180+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:13.674180+0000","last_peered":"2024-09-16T16:47:13.674180+0000","last_clean":"2024-09-16T16:47:13.674180+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:13.674180+0000","last_undegraded":"2024-09-16T16:47:13.674180+0000","last_fullsized":"2024-09-16T16:47:13.674180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.587463+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:13.587463+0000","last_peered":"2024-09-16T16:47:13.587463+0000","last_clean":"2024-09-16T16:47:13.587463+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:13.587463+0000","last_undegraded":"2024-09-16T16:47:13.587463+0000","last_fullsized":"2024-09-16T16:47:13.587463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.733788+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:13.733788+0000","last_peered":"2024-09-16T16:47:13.733788+0000","last_clean":"2024-09-16T16:47:13.733788+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:13.733788+0000","last_undegraded":"2024-09-16T16:47:13.733788+0000","last_fullsized":"2024-09-16T16:47:13.733788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'120","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.657747+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:13.657747+0000","last_peered":"2024-09-16T16:47:13.657747+0000","last_clean":"2024-09-16T16:47:13.657747+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:13.657747+0000","last_undegraded":"2024-09-16T16:47:13.657747+0000","last_fullsized":"2024-09-16T16:47:13.657747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'125","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.800833+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:13.800833+0000","last_peered":"2024-09-16T16:47:13.800833+0000","last_clean":"2024-09-16T16:47:13.800833+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:13.800833+0000","last_undegraded":"2024-09-16T16:47:13.800833+0000","last_fullsized":"2024-09-16T16:47:13.800833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'110","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.532238+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:13.532238+0000","last_peered":"2024-09-16T16:47:13.532238+0000","last_clean":"2024-09-16T16:47:13.532238+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:13.532238+0000","last_undegraded":"2024-09-16T16:47:13.532238+0000","last_fullsized":"2024-09-16T16:47:13.532238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'133","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.777259+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:13.777259+0000","last_peered":"2024-09-16T16:47:13.777259+0000","last_clean":"2024-09-16T16:47:13.777259+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:13.777259+0000","last_undegraded":"2024-09-16T16:47:13.777259+0000","last_fullsized":"2024-09-16T16:47:13.777259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.668188+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:13.668188+0000","last_peered":"2024-09-16T16:47:13.668188+0000","last_clean":"2024-09-16T16:47:13.668188+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:13.668188+0000","last_undegraded":"2024-09-16T16:47:13.668188+0000","last_fullsized":"2024-09-16T16:47:13.668188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.798288+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:13.798288+0000","last_peered":"2024-09-16T16:47:13.798288+0000","last_clean":"2024-09-16T16:47:13.798288+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:13.798288+0000","last_undegraded":"2024-09-16T16:47:13.798288+0000","last_fullsized":"2024-09-16T16:47:13.798288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431156736,"internally_reserved":0,"allocated":780337152,"data_stored":780337152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431685120,"internally_reserved":0,"allocated":779808768,"data_stored":779808768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":209376,"kb_used_data":209376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52088352,"statfs":{"total":53552873472,"available":53338472448,"internally_reserved":0,"allocated":214401024,"data_stored":214401024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164060,"kb_used_data":164060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52133668,"statfs":{"total":53552873472,"available":53384876032,"internally_reserved":0,"allocated":167997440,"data_stored":167997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":177148,"kb_used_data":177148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120580,"statfs":{"total":53552873472,"available":53371473920,"internally_reserved":0,"allocated":181399552,"data_stored":181399552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161808,"kb_used_data":161808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135920,"statfs":{"total":53552873472,"available":53387182080,"internally_reserved":0,"allocated":165691392,"data_stored":165691392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53358776320,"internally_reserved":0,"allocated":194097152,"data_stored":194097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53373722624,"internally_reserved":0,"allocated":179150848,"data_stored":179150848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53358645248,"internally_reserved":0,"allocated":194228224,"data_stored":194228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53373587456,"internally_reserved":0,"allocated":179286016,"data_stored":179286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53323202560,"internally_reserved":0,"allocated":229670912,"data_stored":229670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:17.194 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 2411 2395 7.87752 8.375 0.108327 0.126449 2024-09-16T16:47:17.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:18.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:18.040+0000 7eff3ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:18.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:18.047+0000 7eff3ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:18.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:47:18.195334+0000 min lat: 0.0237797 max lat: 0.716542 avg lat: 0.125466 2024-09-16T16:47:18.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:18.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 2557 2541 7.93985 9.125 0.108827 0.125466 2024-09-16T16:47:19.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 2689 2673 7.95457 8.25 0.138183 0.125217 2024-09-16T16:47:19.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:19.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:19.831+0000 7f8e782a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:19.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:19.841+0000 7f8e782a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2827 2811 7.98501 8.625 0.0583778 0.124856 2024-09-16T16:47:20.215 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:20.216 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:20.241 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-16T16:47:19.762701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129040947,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2041,"num_write_kb":126548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2015,"ondisk_log_size":2015,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":712392,"kb_used_data":712392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208478520,"statfs":{"total":214211493888,"available":213482004480,"internally_reserved":0,"allocated":729489408,"data_stored":729489408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002820"},"pg_stats":[{"pgid":"3.f","version":"23'115","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.649421+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:13.649421+0000","last_peered":"2024-09-16T16:47:13.649421+0000","last_clean":"2024-09-16T16:47:13.649421+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:13.649421+0000","last_undegraded":"2024-09-16T16:47:13.649421+0000","last_fullsized":"2024-09-16T16:47:13.649421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.845572+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:13.845572+0000","last_peered":"2024-09-16T16:47:13.845572+0000","last_clean":"2024-09-16T16:47:13.845572+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:13.845572+0000","last_undegraded":"2024-09-16T16:47:13.845572+0000","last_fullsized":"2024-09-16T16:47:13.845572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'126","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.492207+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:13.492207+0000","last_peered":"2024-09-16T16:47:13.492207+0000","last_clean":"2024-09-16T16:47:13.492207+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:13.492207+0000","last_undegraded":"2024-09-16T16:47:13.492207+0000","last_fullsized":"2024-09-16T16:47:13.492207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.377346+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:13.377346+0000","last_peered":"2024-09-16T16:47:13.377346+0000","last_clean":"2024-09-16T16:47:13.377346+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:13.377346+0000","last_undegraded":"2024-09-16T16:47:13.377346+0000","last_fullsized":"2024-09-16T16:47:13.377346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.786323+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:13.786323+0000","last_peered":"2024-09-16T16:47:13.786323+0000","last_clean":"2024-09-16T16:47:13.786323+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:13.786323+0000","last_undegraded":"2024-09-16T16:47:13.786323+0000","last_fullsized":"2024-09-16T16:47:13.786323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.557256+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:13.557256+0000","last_peered":"2024-09-16T16:47:13.557256+0000","last_clean":"2024-09-16T16:47:13.557256+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:13.557256+0000","last_undegraded":"2024-09-16T16:47:13.557256+0000","last_fullsized":"2024-09-16T16:47:13.557256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'118","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.563589+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:13.563589+0000","last_peered":"2024-09-16T16:47:13.563589+0000","last_clean":"2024-09-16T16:47:13.563589+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:13.563589+0000","last_undegraded":"2024-09-16T16:47:13.563589+0000","last_fullsized":"2024-09-16T16:47:13.563589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'134","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.674180+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:13.674180+0000","last_peered":"2024-09-16T16:47:13.674180+0000","last_clean":"2024-09-16T16:47:13.674180+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:13.674180+0000","last_undegraded":"2024-09-16T16:47:13.674180+0000","last_fullsized":"2024-09-16T16:47:13.674180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.587463+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:13.587463+0000","last_peered":"2024-09-16T16:47:13.587463+0000","last_clean":"2024-09-16T16:47:13.587463+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:13.587463+0000","last_undegraded":"2024-09-16T16:47:13.587463+0000","last_fullsized":"2024-09-16T16:47:13.587463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.733788+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:13.733788+0000","last_peered":"2024-09-16T16:47:13.733788+0000","last_clean":"2024-09-16T16:47:13.733788+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:13.733788+0000","last_undegraded":"2024-09-16T16:47:13.733788+0000","last_fullsized":"2024-09-16T16:47:13.733788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'120","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.657747+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:13.657747+0000","last_peered":"2024-09-16T16:47:13.657747+0000","last_clean":"2024-09-16T16:47:13.657747+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:13.657747+0000","last_undegraded":"2024-09-16T16:47:13.657747+0000","last_fullsized":"2024-09-16T16:47:13.657747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'125","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.800833+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:13.800833+0000","last_peered":"2024-09-16T16:47:13.800833+0000","last_clean":"2024-09-16T16:47:13.800833+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:13.800833+0000","last_undegraded":"2024-09-16T16:47:13.800833+0000","last_fullsized":"2024-09-16T16:47:13.800833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'110","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.532238+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:13.532238+0000","last_peered":"2024-09-16T16:47:13.532238+0000","last_clean":"2024-09-16T16:47:13.532238+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:13.532238+0000","last_undegraded":"2024-09-16T16:47:13.532238+0000","last_fullsized":"2024-09-16T16:47:13.532238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'133","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.777259+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:13.777259+0000","last_peered":"2024-09-16T16:47:13.777259+0000","last_clean":"2024-09-16T16:47:13.777259+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:13.777259+0000","last_undegraded":"2024-09-16T16:47:13.777259+0000","last_fullsized":"2024-09-16T16:47:13.777259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.668188+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:13.668188+0000","last_peered":"2024-09-16T16:47:13.668188+0000","last_clean":"2024-09-16T16:47:13.668188+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:13.668188+0000","last_undegraded":"2024-09-16T16:47:13.668188+0000","last_fullsized":"2024-09-16T16:47:13.668188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.798288+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:13.798288+0000","last_peered":"2024-09-16T16:47:13.798288+0000","last_clean":"2024-09-16T16:47:13.798288+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:13.798288+0000","last_undegraded":"2024-09-16T16:47:13.798288+0000","last_fullsized":"2024-09-16T16:47:13.798288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431156736,"internally_reserved":0,"allocated":780337152,"data_stored":780337152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431685120,"internally_reserved":0,"allocated":779808768,"data_stored":779808768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":209376,"kb_used_data":209376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52088352,"statfs":{"total":53552873472,"available":53338472448,"internally_reserved":0,"allocated":214401024,"data_stored":214401024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164060,"kb_used_data":164060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52133668,"statfs":{"total":53552873472,"available":53384876032,"internally_reserved":0,"allocated":167997440,"data_stored":167997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":177148,"kb_used_data":177148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120580,"statfs":{"total":53552873472,"available":53371473920,"internally_reserved":0,"allocated":181399552,"data_stored":181399552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161808,"kb_used_data":161808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135920,"statfs":{"total":53552873472,"available":53387182080,"internally_reserved":0,"allocated":165691392,"data_stored":165691392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53358776320,"internally_reserved":0,"allocated":194097152,"data_stored":194097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53373722624,"internally_reserved":0,"allocated":179150848,"data_stored":179150848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53358645248,"internally_reserved":0,"allocated":194228224,"data_stored":194228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53373587456,"internally_reserved":0,"allocated":179286016,"data_stored":179286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53323202560,"internally_reserved":0,"allocated":229670912,"data_stored":229670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:20.242 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:47:20.242 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:20.242 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:20.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:20.391+0000 7f685c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:20.406+0000 7f685c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:20.575+0000 7ff124c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:20.589+0000 7ff124c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.756 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:20.757 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-16T16:47:19.762701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129040947,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2041,"num_write_kb":126548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2015,"ondisk_log_size":2015,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":712392,"kb_used_data":712392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208478520,"statfs":{"total":214211493888,"available":213482004480,"internally_reserved":0,"allocated":729489408,"data_stored":729489408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002820"},"pg_stats":[{"pgid":"3.f","version":"23'115","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.649421+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:13.649421+0000","last_peered":"2024-09-16T16:47:13.649421+0000","last_clean":"2024-09-16T16:47:13.649421+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:13.649421+0000","last_undegraded":"2024-09-16T16:47:13.649421+0000","last_fullsized":"2024-09-16T16:47:13.649421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.845572+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:13.845572+0000","last_peered":"2024-09-16T16:47:13.845572+0000","last_clean":"2024-09-16T16:47:13.845572+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:13.845572+0000","last_undegraded":"2024-09-16T16:47:13.845572+0000","last_fullsized":"2024-09-16T16:47:13.845572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'126","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.492207+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:13.492207+0000","last_peered":"2024-09-16T16:47:13.492207+0000","last_clean":"2024-09-16T16:47:13.492207+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:13.492207+0000","last_undegraded":"2024-09-16T16:47:13.492207+0000","last_fullsized":"2024-09-16T16:47:13.492207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.377346+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:13.377346+0000","last_peered":"2024-09-16T16:47:13.377346+0000","last_clean":"2024-09-16T16:47:13.377346+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:13.377346+0000","last_undegraded":"2024-09-16T16:47:13.377346+0000","last_fullsized":"2024-09-16T16:47:13.377346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.786323+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:13.786323+0000","last_peered":"2024-09-16T16:47:13.786323+0000","last_clean":"2024-09-16T16:47:13.786323+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:13.786323+0000","last_undegraded":"2024-09-16T16:47:13.786323+0000","last_fullsized":"2024-09-16T16:47:13.786323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.557256+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:13.557256+0000","last_peered":"2024-09-16T16:47:13.557256+0000","last_clean":"2024-09-16T16:47:13.557256+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:13.557256+0000","last_undegraded":"2024-09-16T16:47:13.557256+0000","last_fullsized":"2024-09-16T16:47:13.557256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'118","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.563589+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:13.563589+0000","last_peered":"2024-09-16T16:47:13.563589+0000","last_clean":"2024-09-16T16:47:13.563589+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:13.563589+0000","last_undegraded":"2024-09-16T16:47:13.563589+0000","last_fullsized":"2024-09-16T16:47:13.563589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'134","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.674180+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:13.674180+0000","last_peered":"2024-09-16T16:47:13.674180+0000","last_clean":"2024-09-16T16:47:13.674180+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:13.674180+0000","last_undegraded":"2024-09-16T16:47:13.674180+0000","last_fullsized":"2024-09-16T16:47:13.674180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.587463+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:13.587463+0000","last_peered":"2024-09-16T16:47:13.587463+0000","last_clean":"2024-09-16T16:47:13.587463+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:13.587463+0000","last_undegraded":"2024-09-16T16:47:13.587463+0000","last_fullsized":"2024-09-16T16:47:13.587463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.733788+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:13.733788+0000","last_peered":"2024-09-16T16:47:13.733788+0000","last_clean":"2024-09-16T16:47:13.733788+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:13.733788+0000","last_undegraded":"2024-09-16T16:47:13.733788+0000","last_fullsized":"2024-09-16T16:47:13.733788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'120","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.657747+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:13.657747+0000","last_peered":"2024-09-16T16:47:13.657747+0000","last_clean":"2024-09-16T16:47:13.657747+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:13.657747+0000","last_undegraded":"2024-09-16T16:47:13.657747+0000","last_fullsized":"2024-09-16T16:47:13.657747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'125","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.800833+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:13.800833+0000","last_peered":"2024-09-16T16:47:13.800833+0000","last_clean":"2024-09-16T16:47:13.800833+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:13.800833+0000","last_undegraded":"2024-09-16T16:47:13.800833+0000","last_fullsized":"2024-09-16T16:47:13.800833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'110","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.532238+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:13.532238+0000","last_peered":"2024-09-16T16:47:13.532238+0000","last_clean":"2024-09-16T16:47:13.532238+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:13.532238+0000","last_undegraded":"2024-09-16T16:47:13.532238+0000","last_fullsized":"2024-09-16T16:47:13.532238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'133","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.777259+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:13.777259+0000","last_peered":"2024-09-16T16:47:13.777259+0000","last_clean":"2024-09-16T16:47:13.777259+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:13.777259+0000","last_undegraded":"2024-09-16T16:47:13.777259+0000","last_fullsized":"2024-09-16T16:47:13.777259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.668188+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:13.668188+0000","last_peered":"2024-09-16T16:47:13.668188+0000","last_clean":"2024-09-16T16:47:13.668188+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:13.668188+0000","last_undegraded":"2024-09-16T16:47:13.668188+0000","last_fullsized":"2024-09-16T16:47:13.668188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.798288+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:13.798288+0000","last_peered":"2024-09-16T16:47:13.798288+0000","last_clean":"2024-09-16T16:47:13.798288+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:13.798288+0000","last_undegraded":"2024-09-16T16:47:13.798288+0000","last_fullsized":"2024-09-16T16:47:13.798288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431156736,"internally_reserved":0,"allocated":780337152,"data_stored":780337152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431685120,"internally_reserved":0,"allocated":779808768,"data_stored":779808768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":209376,"kb_used_data":209376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52088352,"statfs":{"total":53552873472,"available":53338472448,"internally_reserved":0,"allocated":214401024,"data_stored":214401024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164060,"kb_used_data":164060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52133668,"statfs":{"total":53552873472,"available":53384876032,"internally_reserved":0,"allocated":167997440,"data_stored":167997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":177148,"kb_used_data":177148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120580,"statfs":{"total":53552873472,"available":53371473920,"internally_reserved":0,"allocated":181399552,"data_stored":181399552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161808,"kb_used_data":161808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135920,"statfs":{"total":53552873472,"available":53387182080,"internally_reserved":0,"allocated":165691392,"data_stored":165691392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53358776320,"internally_reserved":0,"allocated":194097152,"data_stored":194097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53373722624,"internally_reserved":0,"allocated":179150848,"data_stored":179150848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53358645248,"internally_reserved":0,"allocated":194228224,"data_stored":194228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53373587456,"internally_reserved":0,"allocated":179286016,"data_stored":179286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53323202560,"internally_reserved":0,"allocated":229670912,"data_stored":229670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:21.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2962 2946 8.00465 8.4375 0.0914829 0.124592 2024-09-16T16:47:22.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 3088 3072 7.99922 7.875 0.0436037 0.12449 2024-09-16T16:47:23.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:23.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:23.151+0000 7efd8e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:23.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:23.158+0000 7efd8e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:23.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 3209 3193 7.98172 7.5625 0.117753 0.124854 2024-09-16T16:47:24.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 3343 3327 7.99682 8.375 0.0791972 0.124768 2024-09-16T16:47:25.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 3482 3466 8.02237 8.6875 0.125494 0.124339 2024-09-16T16:47:25.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:25.785 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:25.785 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:25.785 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:47:25.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:47:25.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:25.784+0000 7fe6de87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:25.794+0000 7fe6de87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:25.937+0000 7f22ab4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:25.954+0000 7f22ab4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.997 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:25.997 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:25.998 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:26.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:26.002 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:26.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:47:26.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 3619 3603 8.04161 8.5625 0.192987 0.12407 2024-09-16T16:47:26.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.196+0000 7fb14ec7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.214+0000 7fb14ec7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:26.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:26.338 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:26.338 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:26.338 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:26.341 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:26.341 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:26.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:47:26.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.502+0000 7f28892a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.516+0000 7f28892a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:26.550 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:26.550 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:26.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:26.554 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:26.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:47:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.721+0000 7fc63ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:26.735+0000 7fc63ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:26.851 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:26.852 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:26.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:26.855 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:27.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 3757 3741 8.0617 8.625 0.118293 0.123786 2024-09-16T16:47:28.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:28.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 3880 3864 8.0492 7.6875 0.0713131 0.123796 2024-09-16T16:47:28.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:28.290+0000 7fc4eaa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:28.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:28.301+0000 7fc4eaa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:29.195 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3999 3983 8.02945 7.4375 0.110095 0.124182 2024-09-16T16:47:30.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 4133 4117 8.04023 8.375 0.11022 0.124156 2024-09-16T16:47:30.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:30.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:30.907+0000 7f2a4eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:30.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:30.915+0000 7f2a4eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:31.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 4261 4245 8.03899 8 0.0844848 0.124076 2024-09-16T16:47:31.856 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:31.857 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:31.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:32.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:32.015+0000 7fe27e863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:32.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:32.026+0000 7fe27e863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:32.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 4395 4379 8.04885 8.375 0.0987676 0.124001 2024-09-16T16:47:32.353 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:32.354 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:32.379 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-16T16:47:31.765266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129040947,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2041,"num_write_kb":126548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2015,"ondisk_log_size":2015,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":712392,"kb_used_data":712392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208478520,"statfs":{"total":214211493888,"available":213482004480,"internally_reserved":0,"allocated":729489408,"data_stored":729489408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002564"},"pg_stats":[{"pgid":"3.f","version":"23'115","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.649421+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:13.649421+0000","last_peered":"2024-09-16T16:47:13.649421+0000","last_clean":"2024-09-16T16:47:13.649421+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:13.649421+0000","last_undegraded":"2024-09-16T16:47:13.649421+0000","last_fullsized":"2024-09-16T16:47:13.649421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.845572+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:13.845572+0000","last_peered":"2024-09-16T16:47:13.845572+0000","last_clean":"2024-09-16T16:47:13.845572+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:13.845572+0000","last_undegraded":"2024-09-16T16:47:13.845572+0000","last_fullsized":"2024-09-16T16:47:13.845572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'126","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.492207+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:13.492207+0000","last_peered":"2024-09-16T16:47:13.492207+0000","last_clean":"2024-09-16T16:47:13.492207+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:13.492207+0000","last_undegraded":"2024-09-16T16:47:13.492207+0000","last_fullsized":"2024-09-16T16:47:13.492207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.377346+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:13.377346+0000","last_peered":"2024-09-16T16:47:13.377346+0000","last_clean":"2024-09-16T16:47:13.377346+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:13.377346+0000","last_undegraded":"2024-09-16T16:47:13.377346+0000","last_fullsized":"2024-09-16T16:47:13.377346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.786323+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:13.786323+0000","last_peered":"2024-09-16T16:47:13.786323+0000","last_clean":"2024-09-16T16:47:13.786323+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:13.786323+0000","last_undegraded":"2024-09-16T16:47:13.786323+0000","last_fullsized":"2024-09-16T16:47:13.786323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.557256+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:13.557256+0000","last_peered":"2024-09-16T16:47:13.557256+0000","last_clean":"2024-09-16T16:47:13.557256+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:13.557256+0000","last_undegraded":"2024-09-16T16:47:13.557256+0000","last_fullsized":"2024-09-16T16:47:13.557256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'118","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.563589+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:13.563589+0000","last_peered":"2024-09-16T16:47:13.563589+0000","last_clean":"2024-09-16T16:47:13.563589+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:13.563589+0000","last_undegraded":"2024-09-16T16:47:13.563589+0000","last_fullsized":"2024-09-16T16:47:13.563589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'134","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.674180+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:13.674180+0000","last_peered":"2024-09-16T16:47:13.674180+0000","last_clean":"2024-09-16T16:47:13.674180+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:13.674180+0000","last_undegraded":"2024-09-16T16:47:13.674180+0000","last_fullsized":"2024-09-16T16:47:13.674180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.587463+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:13.587463+0000","last_peered":"2024-09-16T16:47:13.587463+0000","last_clean":"2024-09-16T16:47:13.587463+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:13.587463+0000","last_undegraded":"2024-09-16T16:47:13.587463+0000","last_fullsized":"2024-09-16T16:47:13.587463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.733788+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:13.733788+0000","last_peered":"2024-09-16T16:47:13.733788+0000","last_clean":"2024-09-16T16:47:13.733788+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:13.733788+0000","last_undegraded":"2024-09-16T16:47:13.733788+0000","last_fullsized":"2024-09-16T16:47:13.733788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'120","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.657747+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:13.657747+0000","last_peered":"2024-09-16T16:47:13.657747+0000","last_clean":"2024-09-16T16:47:13.657747+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:13.657747+0000","last_undegraded":"2024-09-16T16:47:13.657747+0000","last_fullsized":"2024-09-16T16:47:13.657747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'125","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.800833+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:13.800833+0000","last_peered":"2024-09-16T16:47:13.800833+0000","last_clean":"2024-09-16T16:47:13.800833+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:13.800833+0000","last_undegraded":"2024-09-16T16:47:13.800833+0000","last_fullsized":"2024-09-16T16:47:13.800833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'110","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.532238+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:13.532238+0000","last_peered":"2024-09-16T16:47:13.532238+0000","last_clean":"2024-09-16T16:47:13.532238+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:13.532238+0000","last_undegraded":"2024-09-16T16:47:13.532238+0000","last_fullsized":"2024-09-16T16:47:13.532238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'133","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.777259+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:13.777259+0000","last_peered":"2024-09-16T16:47:13.777259+0000","last_clean":"2024-09-16T16:47:13.777259+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:13.777259+0000","last_undegraded":"2024-09-16T16:47:13.777259+0000","last_fullsized":"2024-09-16T16:47:13.777259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.668188+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:13.668188+0000","last_peered":"2024-09-16T16:47:13.668188+0000","last_clean":"2024-09-16T16:47:13.668188+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:13.668188+0000","last_undegraded":"2024-09-16T16:47:13.668188+0000","last_fullsized":"2024-09-16T16:47:13.668188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.798288+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:13.798288+0000","last_peered":"2024-09-16T16:47:13.798288+0000","last_clean":"2024-09-16T16:47:13.798288+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:13.798288+0000","last_undegraded":"2024-09-16T16:47:13.798288+0000","last_fullsized":"2024-09-16T16:47:13.798288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431156736,"internally_reserved":0,"allocated":780337152,"data_stored":780337152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431685120,"internally_reserved":0,"allocated":779808768,"data_stored":779808768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":209376,"kb_used_data":209376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52088352,"statfs":{"total":53552873472,"available":53338472448,"internally_reserved":0,"allocated":214401024,"data_stored":214401024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164060,"kb_used_data":164060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52133668,"statfs":{"total":53552873472,"available":53384876032,"internally_reserved":0,"allocated":167997440,"data_stored":167997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":177148,"kb_used_data":177148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120580,"statfs":{"total":53552873472,"available":53371473920,"internally_reserved":0,"allocated":181399552,"data_stored":181399552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161808,"kb_used_data":161808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135920,"statfs":{"total":53552873472,"available":53387182080,"internally_reserved":0,"allocated":165691392,"data_stored":165691392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53358776320,"internally_reserved":0,"allocated":194097152,"data_stored":194097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53373722624,"internally_reserved":0,"allocated":179150848,"data_stored":179150848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53358645248,"internally_reserved":0,"allocated":194228224,"data_stored":194228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53373587456,"internally_reserved":0,"allocated":179286016,"data_stored":179286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53323202560,"internally_reserved":0,"allocated":229670912,"data_stored":229670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:33.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 4520 4504 8.04207 7.8125 0.0962138 0.12391 2024-09-16T16:47:33.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:33.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:33.590+0000 7fa323351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:33.601+0000 7fa323351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:34.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 4646 4630 8.03742 7.875 0.0815638 0.124132 2024-09-16T16:47:35.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 4777 4761 8.04145 8.1875 0.0842215 0.12419 2024-09-16T16:47:36.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:36.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 4914 4898 8.05515 8.5625 0.10663 0.12388 2024-09-16T16:47:36.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:36.277+0000 7f39da6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:36.285+0000 7f39da6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:37.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 5045 5029 8.05852 8.1875 0.170043 0.123791 2024-09-16T16:47:37.381 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:37.381 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:37.382 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:37.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:37.531+0000 7f6535f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:37.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:37.543+0000 7f6535f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:37.909 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:37.909 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:37.927 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-16T16:47:37.766602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129040947,"num_objects":1964,"num_object_clones":0,"num_object_copies":5892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2041,"num_write_kb":126548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2015,"ondisk_log_size":2015,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":712392,"kb_used_data":712392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208478520,"statfs":{"total":214211493888,"available":213482004480,"internally_reserved":0,"allocated":729489408,"data_stored":729489408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002653"},"pg_stats":[{"pgid":"3.f","version":"23'115","reported_seq":139,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.649421+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:13.649421+0000","last_peered":"2024-09-16T16:47:13.649421+0000","last_clean":"2024-09-16T16:47:13.649421+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:13.649421+0000","last_undegraded":"2024-09-16T16:47:13.649421+0000","last_fullsized":"2024-09-16T16:47:13.649421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.845572+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:13.845572+0000","last_peered":"2024-09-16T16:47:13.845572+0000","last_clean":"2024-09-16T16:47:13.845572+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:13.845572+0000","last_undegraded":"2024-09-16T16:47:13.845572+0000","last_fullsized":"2024-09-16T16:47:13.845572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'126","reported_seq":150,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.492207+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:13.492207+0000","last_peered":"2024-09-16T16:47:13.492207+0000","last_clean":"2024-09-16T16:47:13.492207+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:13.492207+0000","last_undegraded":"2024-09-16T16:47:13.492207+0000","last_fullsized":"2024-09-16T16:47:13.492207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'119","reported_seq":143,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.377346+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:13.377346+0000","last_peered":"2024-09-16T16:47:13.377346+0000","last_clean":"2024-09-16T16:47:13.377346+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:13.377346+0000","last_undegraded":"2024-09-16T16:47:13.377346+0000","last_fullsized":"2024-09-16T16:47:13.377346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'112","reported_seq":136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.786323+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:13.786323+0000","last_peered":"2024-09-16T16:47:13.786323+0000","last_clean":"2024-09-16T16:47:13.786323+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:13.786323+0000","last_undegraded":"2024-09-16T16:47:13.786323+0000","last_fullsized":"2024-09-16T16:47:13.786323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'111","reported_seq":135,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.557256+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:13.557256+0000","last_peered":"2024-09-16T16:47:13.557256+0000","last_clean":"2024-09-16T16:47:13.557256+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:13.557256+0000","last_undegraded":"2024-09-16T16:47:13.557256+0000","last_fullsized":"2024-09-16T16:47:13.557256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'118","reported_seq":142,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.563589+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:13.563589+0000","last_peered":"2024-09-16T16:47:13.563589+0000","last_clean":"2024-09-16T16:47:13.563589+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:13.563589+0000","last_undegraded":"2024-09-16T16:47:13.563589+0000","last_fullsized":"2024-09-16T16:47:13.563589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'134","reported_seq":158,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.674180+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:13.674180+0000","last_peered":"2024-09-16T16:47:13.674180+0000","last_clean":"2024-09-16T16:47:13.674180+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:13.674180+0000","last_undegraded":"2024-09-16T16:47:13.674180+0000","last_fullsized":"2024-09-16T16:47:13.674180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'137","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.587463+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:13.587463+0000","last_peered":"2024-09-16T16:47:13.587463+0000","last_clean":"2024-09-16T16:47:13.587463+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:13.587463+0000","last_undegraded":"2024-09-16T16:47:13.587463+0000","last_fullsized":"2024-09-16T16:47:13.587463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.733788+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:13.733788+0000","last_peered":"2024-09-16T16:47:13.733788+0000","last_clean":"2024-09-16T16:47:13.733788+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:13.733788+0000","last_undegraded":"2024-09-16T16:47:13.733788+0000","last_fullsized":"2024-09-16T16:47:13.733788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'120","reported_seq":144,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.657747+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:13.657747+0000","last_peered":"2024-09-16T16:47:13.657747+0000","last_clean":"2024-09-16T16:47:13.657747+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:13.657747+0000","last_undegraded":"2024-09-16T16:47:13.657747+0000","last_fullsized":"2024-09-16T16:47:13.657747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'125","reported_seq":149,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.800833+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:13.800833+0000","last_peered":"2024-09-16T16:47:13.800833+0000","last_clean":"2024-09-16T16:47:13.800833+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:13.800833+0000","last_undegraded":"2024-09-16T16:47:13.800833+0000","last_fullsized":"2024-09-16T16:47:13.800833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'110","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.532238+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:13.532238+0000","last_peered":"2024-09-16T16:47:13.532238+0000","last_clean":"2024-09-16T16:47:13.532238+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:13.532238+0000","last_undegraded":"2024-09-16T16:47:13.532238+0000","last_fullsized":"2024-09-16T16:47:13.532238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'133","reported_seq":157,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.777259+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:13.777259+0000","last_peered":"2024-09-16T16:47:13.777259+0000","last_clean":"2024-09-16T16:47:13.777259+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:13.777259+0000","last_undegraded":"2024-09-16T16:47:13.777259+0000","last_fullsized":"2024-09-16T16:47:13.777259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'109","reported_seq":133,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.668188+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:13.668188+0000","last_peered":"2024-09-16T16:47:13.668188+0000","last_clean":"2024-09-16T16:47:13.668188+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:13.668188+0000","last_undegraded":"2024-09-16T16:47:13.668188+0000","last_fullsized":"2024-09-16T16:47:13.668188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'127","reported_seq":151,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:13.798288+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:13.798288+0000","last_peered":"2024-09-16T16:47:13.798288+0000","last_clean":"2024-09-16T16:47:13.798288+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:13.798288+0000","last_undegraded":"2024-09-16T16:47:13.798288+0000","last_fullsized":"2024-09-16T16:47:13.798288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":128450560,"num_objects":1960,"num_object_clones":0,"num_object_copies":5880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":125440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431156736,"internally_reserved":0,"allocated":780337152,"data_stored":780337152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213431685120,"internally_reserved":0,"allocated":779808768,"data_stored":779808768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":209376,"kb_used_data":209376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52088352,"statfs":{"total":53552873472,"available":53338472448,"internally_reserved":0,"allocated":214401024,"data_stored":214401024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":164060,"kb_used_data":164060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52133668,"statfs":{"total":53552873472,"available":53384876032,"internally_reserved":0,"allocated":167997440,"data_stored":167997440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":177148,"kb_used_data":177148,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120580,"statfs":{"total":53552873472,"available":53371473920,"internally_reserved":0,"allocated":181399552,"data_stored":181399552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":161808,"kb_used_data":161808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52135920,"statfs":{"total":53552873472,"available":53387182080,"internally_reserved":0,"allocated":165691392,"data_stored":165691392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53358776320,"internally_reserved":0,"allocated":194097152,"data_stored":194097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53373722624,"internally_reserved":0,"allocated":179150848,"data_stored":179150848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53323464704,"internally_reserved":0,"allocated":229408768,"data_stored":229408768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53375721472,"internally_reserved":0,"allocated":177152000,"data_stored":177152000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53358645248,"internally_reserved":0,"allocated":194228224,"data_stored":194228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53373587456,"internally_reserved":0,"allocated":179286016,"data_stored":179286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53323202560,"internally_reserved":0,"allocated":229670912,"data_stored":229670912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:38.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:47:38.197211+0000 min lat: 0.0237797 max lat: 0.716542 avg lat: 0.123798 2024-09-16T16:47:38.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:38.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 5177 5161 8.06329 8.25 0.0546935 0.123798 2024-09-16T16:47:38.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:38.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:38.725+0000 7f3744991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:38.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:38.731+0000 7f3744991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 5294 5278 8.04497 7.3125 0.0863515 0.124037 2024-09-16T16:47:40.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 5417 5401 8.03644 7.6875 0.0773382 0.124225 2024-09-16T16:47:41.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:41.196 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 5540 5524 8.02831 7.6875 0.140813 0.124353 2024-09-16T16:47:41.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:41.317+0000 7f71a6aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:41.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:41.324+0000 7f71a6aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:42.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 5655 5639 8.00918 7.1875 0.210754 0.124525 2024-09-16T16:47:42.929 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:42.929 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:42.929 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:47:42.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:47:43.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.091+0000 7f2529391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.103+0000 7f2529391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.129 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:43.130 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:43.133 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:43.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:43.134 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:47:43.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 5779 5763 8.0034 7.75 0.0505795 0.124724 2024-09-16T16:47:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.280+0000 7f0804791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.292+0000 7f0804791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.326 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:43.326 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:43.327 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:43.331 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:43.332 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:43.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:47:43.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.510+0000 7fa08dca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.527+0000 7fa08dca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:43.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:43.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:43.586 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:43.586 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:43.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:43.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:43.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:47:43.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:43.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.758+0000 7fa4ca191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.780+0000 7fa4ca191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.852+0000 7ffa0ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:43.862+0000 7ffa0ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:43.920 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:43.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:43.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:43.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:43.921 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:43.921 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:43.924 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:43.925 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:44.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 5911 5895 8.00874 8.25 0.138695 0.124681 2024-09-16T16:47:45.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 6030 6014 7.99657 7.4375 0.281907 0.124711 2024-09-16T16:47:46.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:46.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 6148 6132 7.98361 7.375 0.057507 0.124994 2024-09-16T16:47:46.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:46.333+0000 7f058b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:46.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:46.341+0000 7f058b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:47.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 6272 6256 7.97883 7.75 0.13903 0.125155 2024-09-16T16:47:48.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 6396 6380 7.97424 7.75 0.157951 0.125186 2024-09-16T16:47:48.706 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:48.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:48.869+0000 7f3b21711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:48.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:48.877+0000 7f3b21711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:48.926 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:48.926 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:48.926 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:47:48.926 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:47:49.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.076+0000 7fba2b87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.093+0000 7fba2b87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:49.143 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:49.143 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:49.143 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:49.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:49.145 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:49.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:47:49.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 6503 6487 7.949 6.6875 0.0516301 0.125473 2024-09-16T16:47:49.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.344+0000 7f776a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.356+0000 7f776a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:49.379 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:49.380 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:49.380 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:49.380 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:49.383 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:49.384 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:49.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:47:49.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.572+0000 7f4548f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.583+0000 7f4548f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:49.707 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:49.708 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:49.711 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:49.712 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:49.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:47:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.866+0000 7f7ab2e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:49.881+0000 7f7ab2e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:47:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:47:50.014 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:47:50.015 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:47:50.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:50.019 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:50.197 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 6624 6608 7.94155 7.5625 0.091084 0.125746 2024-09-16T16:47:51.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:51.193+0000 7f740f86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:51.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 6739 6723 7.92731 7.1875 0.263745 0.125908 2024-09-16T16:47:51.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:51.199+0000 7f740f86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:52.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 6860 6844 7.92054 7.5625 0.312637 0.125953 2024-09-16T16:47:53.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 6969 6953 7.90038 6.8125 0.0619574 0.126285 2024-09-16T16:47:53.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:53.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:53.770+0000 7f3990b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:53.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:53.778+0000 7f3990b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:54.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 7087 7071 7.89099 7.375 0.161097 0.126537 2024-09-16T16:47:55.020 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:55.021 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:55.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:55.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:55.156+0000 7f22810ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:55.169+0000 7f22810ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:55.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 7208 7192 7.88522 7.5625 0.132215 0.126702 2024-09-16T16:47:55.483 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:47:55.483 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:47:55.499 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-16T16:47:53.769989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384631347,"num_objects":5864,"num_object_clones":0,"num_object_copies":17592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5941,"num_write_kb":376148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5915,"ondisk_log_size":5915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2226672,"kb_used_data":2226672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206964240,"statfs":{"total":214211493888,"available":211931381760,"internally_reserved":0,"allocated":2280112128,"data_stored":2280112128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":255590400,"num_objects":3900,"num_object_clones":0,"num_object_copies":11700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3900,"num_write_kb":249600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002585"},"pg_stats":[{"pgid":"3.f","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.194925+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:43.194925+0000","last_peered":"2024-09-16T16:47:43.194925+0000","last_clean":"2024-09-16T16:47:43.194925+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:43.194925+0000","last_undegraded":"2024-09-16T16:47:43.194925+0000","last_fullsized":"2024-09-16T16:47:43.194925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'341","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.752991+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:43.752991+0000","last_peered":"2024-09-16T16:47:43.752991+0000","last_clean":"2024-09-16T16:47:43.752991+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:43.752991+0000","last_undegraded":"2024-09-16T16:47:43.752991+0000","last_fullsized":"2024-09-16T16:47:43.752991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'348","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.724084+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:43.724084+0000","last_peered":"2024-09-16T16:47:43.724084+0000","last_clean":"2024-09-16T16:47:43.724084+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:43.724084+0000","last_undegraded":"2024-09-16T16:47:43.724084+0000","last_fullsized":"2024-09-16T16:47:43.724084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'364","reported_seq":388,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.511068+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:43.511068+0000","last_peered":"2024-09-16T16:47:43.511068+0000","last_clean":"2024-09-16T16:47:43.511068+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:43.511068+0000","last_undegraded":"2024-09-16T16:47:43.511068+0000","last_fullsized":"2024-09-16T16:47:43.511068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'337","reported_seq":361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.823071+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:43.823071+0000","last_peered":"2024-09-16T16:47:43.823071+0000","last_clean":"2024-09-16T16:47:43.823071+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:43.823071+0000","last_undegraded":"2024-09-16T16:47:43.823071+0000","last_fullsized":"2024-09-16T16:47:43.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":21568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'380","reported_seq":404,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.504753+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:43.504753+0000","last_peered":"2024-09-16T16:47:43.504753+0000","last_clean":"2024-09-16T16:47:43.504753+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:43.504753+0000","last_undegraded":"2024-09-16T16:47:43.504753+0000","last_fullsized":"2024-09-16T16:47:43.504753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'376","reported_seq":400,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.550630+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:43.550630+0000","last_peered":"2024-09-16T16:47:43.550630+0000","last_clean":"2024-09-16T16:47:43.550630+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:43.550630+0000","last_undegraded":"2024-09-16T16:47:43.550630+0000","last_fullsized":"2024-09-16T16:47:43.550630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'372","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.665793+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:43.665793+0000","last_peered":"2024-09-16T16:47:43.665793+0000","last_clean":"2024-09-16T16:47:43.665793+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:43.665793+0000","last_undegraded":"2024-09-16T16:47:43.665793+0000","last_fullsized":"2024-09-16T16:47:43.665793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'403","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.606665+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:43.606665+0000","last_peered":"2024-09-16T16:47:43.606665+0000","last_clean":"2024-09-16T16:47:43.606665+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:43.606665+0000","last_undegraded":"2024-09-16T16:47:43.606665+0000","last_fullsized":"2024-09-16T16:47:43.606665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'373","reported_seq":397,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.388136+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:43.388136+0000","last_peered":"2024-09-16T16:47:43.388136+0000","last_clean":"2024-09-16T16:47:43.388136+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:43.388136+0000","last_undegraded":"2024-09-16T16:47:43.388136+0000","last_fullsized":"2024-09-16T16:47:43.388136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.755775+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:43.755775+0000","last_peered":"2024-09-16T16:47:43.755775+0000","last_clean":"2024-09-16T16:47:43.755775+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:43.755775+0000","last_undegraded":"2024-09-16T16:47:43.755775+0000","last_fullsized":"2024-09-16T16:47:43.755775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'367","reported_seq":391,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.620632+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:43.620632+0000","last_peered":"2024-09-16T16:47:43.620632+0000","last_clean":"2024-09-16T16:47:43.620632+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:43.620632+0000","last_undegraded":"2024-09-16T16:47:43.620632+0000","last_fullsized":"2024-09-16T16:47:43.620632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'350","reported_seq":374,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.071657+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:43.071657+0000","last_peered":"2024-09-16T16:47:43.071657+0000","last_clean":"2024-09-16T16:47:43.071657+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:43.071657+0000","last_undegraded":"2024-09-16T16:47:43.071657+0000","last_fullsized":"2024-09-16T16:47:43.071657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":22400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.561016+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:43.561016+0000","last_peered":"2024-09-16T16:47:43.561016+0000","last_clean":"2024-09-16T16:47:43.561016+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:43.561016+0000","last_undegraded":"2024-09-16T16:47:43.561016+0000","last_fullsized":"2024-09-16T16:47:43.561016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'379","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.579842+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:43.579842+0000","last_peered":"2024-09-16T16:47:43.579842+0000","last_clean":"2024-09-16T16:47:43.579842+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:43.579842+0000","last_undegraded":"2024-09-16T16:47:43.579842+0000","last_fullsized":"2024-09-16T16:47:43.579842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'353","reported_seq":377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.678239+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:43.678239+0000","last_peered":"2024-09-16T16:47:43.678239+0000","last_clean":"2024-09-16T16:47:43.678239+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:43.678239+0000","last_undegraded":"2024-09-16T16:47:43.678239+0000","last_fullsized":"2024-09-16T16:47:43.678239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":384040960,"num_objects":5860,"num_object_clones":0,"num_object_copies":17580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5860,"num_write_kb":375040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5860,"ondisk_log_size":5860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":645460,"kb_used_data":645460,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51652268,"statfs":{"total":53552873472,"available":52891922432,"internally_reserved":0,"allocated":660951040,"data_stored":660951040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506824,"kb_used_data":506824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51790904,"statfs":{"total":53552873472,"available":53033885696,"internally_reserved":0,"allocated":518987776,"data_stored":518987776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555792,"kb_used_data":555792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741936,"statfs":{"total":53552873472,"available":52983742464,"internally_reserved":0,"allocated":569131008,"data_stored":569131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":518596,"kb_used_data":518596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51779132,"statfs":{"total":53552873472,"available":53021831168,"internally_reserved":0,"allocated":531042304,"data_stored":531042304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:56.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:56.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 7324 7308 7.87425 7.25 0.0400309 0.126812 2024-09-16T16:47:56.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:56.215+0000 7fb0d8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:56.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:56.220+0000 7fb0d8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:57.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 7425 7409 7.84778 6.3125 0.116724 0.127177 2024-09-16T16:47:58.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:47:58.199056+0000 min lat: 0.0237797 max lat: 0.716542 avg lat: 0.127285 2024-09-16T16:47:58.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:58.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 7546 7530 7.84301 7.5625 0.0757832 0.127285 2024-09-16T16:47:58.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:58.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:58.525+0000 7f7692111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:58.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:47:58.532+0000 7f7692111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:59.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 15 7657 7642 7.82918 7 0.0910954 0.12756 2024-09-16T16:48:00.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 7772 7756 7.81781 7.125 0.113641 0.127712 2024-09-16T16:48:00.501 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:00.502 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:00.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:00.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:00.667+0000 7fefcaa4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:00.677+0000 7fefcaa4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:01.007 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:01.008 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:01.034 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-16T16:47:59.771307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384631347,"num_objects":5864,"num_object_clones":0,"num_object_copies":17592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5941,"num_write_kb":376148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5915,"ondisk_log_size":5915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2226672,"kb_used_data":2226672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206964240,"statfs":{"total":214211493888,"available":211931381760,"internally_reserved":0,"allocated":2280112128,"data_stored":2280112128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"3.f","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.194925+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:43.194925+0000","last_peered":"2024-09-16T16:47:43.194925+0000","last_clean":"2024-09-16T16:47:43.194925+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:43.194925+0000","last_undegraded":"2024-09-16T16:47:43.194925+0000","last_fullsized":"2024-09-16T16:47:43.194925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'341","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.752991+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:43.752991+0000","last_peered":"2024-09-16T16:47:43.752991+0000","last_clean":"2024-09-16T16:47:43.752991+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:43.752991+0000","last_undegraded":"2024-09-16T16:47:43.752991+0000","last_fullsized":"2024-09-16T16:47:43.752991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'348","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.724084+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:43.724084+0000","last_peered":"2024-09-16T16:47:43.724084+0000","last_clean":"2024-09-16T16:47:43.724084+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:43.724084+0000","last_undegraded":"2024-09-16T16:47:43.724084+0000","last_fullsized":"2024-09-16T16:47:43.724084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'364","reported_seq":388,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.511068+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:43.511068+0000","last_peered":"2024-09-16T16:47:43.511068+0000","last_clean":"2024-09-16T16:47:43.511068+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:43.511068+0000","last_undegraded":"2024-09-16T16:47:43.511068+0000","last_fullsized":"2024-09-16T16:47:43.511068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'337","reported_seq":361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.823071+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:43.823071+0000","last_peered":"2024-09-16T16:47:43.823071+0000","last_clean":"2024-09-16T16:47:43.823071+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:43.823071+0000","last_undegraded":"2024-09-16T16:47:43.823071+0000","last_fullsized":"2024-09-16T16:47:43.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":21568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'380","reported_seq":404,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.504753+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:43.504753+0000","last_peered":"2024-09-16T16:47:43.504753+0000","last_clean":"2024-09-16T16:47:43.504753+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:43.504753+0000","last_undegraded":"2024-09-16T16:47:43.504753+0000","last_fullsized":"2024-09-16T16:47:43.504753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'376","reported_seq":400,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.550630+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:43.550630+0000","last_peered":"2024-09-16T16:47:43.550630+0000","last_clean":"2024-09-16T16:47:43.550630+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:43.550630+0000","last_undegraded":"2024-09-16T16:47:43.550630+0000","last_fullsized":"2024-09-16T16:47:43.550630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'372","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.665793+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:43.665793+0000","last_peered":"2024-09-16T16:47:43.665793+0000","last_clean":"2024-09-16T16:47:43.665793+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:43.665793+0000","last_undegraded":"2024-09-16T16:47:43.665793+0000","last_fullsized":"2024-09-16T16:47:43.665793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'403","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.606665+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:43.606665+0000","last_peered":"2024-09-16T16:47:43.606665+0000","last_clean":"2024-09-16T16:47:43.606665+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:43.606665+0000","last_undegraded":"2024-09-16T16:47:43.606665+0000","last_fullsized":"2024-09-16T16:47:43.606665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'373","reported_seq":397,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.388136+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:43.388136+0000","last_peered":"2024-09-16T16:47:43.388136+0000","last_clean":"2024-09-16T16:47:43.388136+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:43.388136+0000","last_undegraded":"2024-09-16T16:47:43.388136+0000","last_fullsized":"2024-09-16T16:47:43.388136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.755775+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:43.755775+0000","last_peered":"2024-09-16T16:47:43.755775+0000","last_clean":"2024-09-16T16:47:43.755775+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:43.755775+0000","last_undegraded":"2024-09-16T16:47:43.755775+0000","last_fullsized":"2024-09-16T16:47:43.755775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'367","reported_seq":391,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.620632+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:43.620632+0000","last_peered":"2024-09-16T16:47:43.620632+0000","last_clean":"2024-09-16T16:47:43.620632+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:43.620632+0000","last_undegraded":"2024-09-16T16:47:43.620632+0000","last_fullsized":"2024-09-16T16:47:43.620632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'350","reported_seq":374,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.071657+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:43.071657+0000","last_peered":"2024-09-16T16:47:43.071657+0000","last_clean":"2024-09-16T16:47:43.071657+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:43.071657+0000","last_undegraded":"2024-09-16T16:47:43.071657+0000","last_fullsized":"2024-09-16T16:47:43.071657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":22400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.561016+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:43.561016+0000","last_peered":"2024-09-16T16:47:43.561016+0000","last_clean":"2024-09-16T16:47:43.561016+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:43.561016+0000","last_undegraded":"2024-09-16T16:47:43.561016+0000","last_fullsized":"2024-09-16T16:47:43.561016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'379","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.579842+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:43.579842+0000","last_peered":"2024-09-16T16:47:43.579842+0000","last_clean":"2024-09-16T16:47:43.579842+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:43.579842+0000","last_undegraded":"2024-09-16T16:47:43.579842+0000","last_fullsized":"2024-09-16T16:47:43.579842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'353","reported_seq":377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.678239+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:43.678239+0000","last_peered":"2024-09-16T16:47:43.678239+0000","last_clean":"2024-09-16T16:47:43.678239+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:43.678239+0000","last_undegraded":"2024-09-16T16:47:43.678239+0000","last_fullsized":"2024-09-16T16:47:43.678239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":384040960,"num_objects":5860,"num_object_clones":0,"num_object_copies":17580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5860,"num_write_kb":375040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5860,"ondisk_log_size":5860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":645460,"kb_used_data":645460,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51652268,"statfs":{"total":53552873472,"available":52891922432,"internally_reserved":0,"allocated":660951040,"data_stored":660951040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506824,"kb_used_data":506824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51790904,"statfs":{"total":53552873472,"available":53033885696,"internally_reserved":0,"allocated":518987776,"data_stored":518987776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555792,"kb_used_data":555792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741936,"statfs":{"total":53552873472,"available":52983742464,"internally_reserved":0,"allocated":569131008,"data_stored":569131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":518596,"kb_used_data":518596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51779132,"statfs":{"total":53552873472,"available":53021831168,"internally_reserved":0,"allocated":531042304,"data_stored":531042304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:01.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:01.072+0000 7ff952e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:01.079+0000 7ff952e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.198 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 7884 7868 7.80482 7 0.104676 0.127926 2024-09-16T16:48:02.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 7992 7976 7.78833 6.75 0.131396 0.128266 2024-09-16T16:48:03.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 8088 8072 7.7608 6 0.173466 0.128502 2024-09-16T16:48:03.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:03.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:03.530+0000 7f2bda311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:03.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:03.538+0000 7f2bda311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:04.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 8197 8181 7.74642 6.8125 0.172099 0.128891 2024-09-16T16:48:05.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 8298 8282 7.72501 6.3125 0.367407 0.129235 2024-09-16T16:48:05.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:06.036 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:06.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:06.036 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:06.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:06.051+0000 7fa454846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:06.062+0000 7fa454846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 8417 8401 7.72077 7.4375 0.231257 0.129319 2024-09-16T16:48:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:06.213+0000 7f66be591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:06.228+0000 7f66be591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.561 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:06.561 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:06.582 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-16T16:48:05.772489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384631347,"num_objects":5864,"num_object_clones":0,"num_object_copies":17592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5941,"num_write_kb":376148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5915,"ondisk_log_size":5915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2226672,"kb_used_data":2226672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206964240,"statfs":{"total":214211493888,"available":211931381760,"internally_reserved":0,"allocated":2280112128,"data_stored":2280112128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002499"},"pg_stats":[{"pgid":"3.f","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.194925+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:47:43.194925+0000","last_peered":"2024-09-16T16:47:43.194925+0000","last_clean":"2024-09-16T16:47:43.194925+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:47:43.194925+0000","last_undegraded":"2024-09-16T16:47:43.194925+0000","last_fullsized":"2024-09-16T16:47:43.194925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'341","reported_seq":365,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.752991+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:47:43.752991+0000","last_peered":"2024-09-16T16:47:43.752991+0000","last_clean":"2024-09-16T16:47:43.752991+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:47:43.752991+0000","last_undegraded":"2024-09-16T16:47:43.752991+0000","last_fullsized":"2024-09-16T16:47:43.752991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'348","reported_seq":372,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.724084+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:47:43.724084+0000","last_peered":"2024-09-16T16:47:43.724084+0000","last_clean":"2024-09-16T16:47:43.724084+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:47:43.724084+0000","last_undegraded":"2024-09-16T16:47:43.724084+0000","last_fullsized":"2024-09-16T16:47:43.724084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'364","reported_seq":388,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.511068+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:47:43.511068+0000","last_peered":"2024-09-16T16:47:43.511068+0000","last_clean":"2024-09-16T16:47:43.511068+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:47:43.511068+0000","last_undegraded":"2024-09-16T16:47:43.511068+0000","last_fullsized":"2024-09-16T16:47:43.511068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'337","reported_seq":361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.823071+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:47:43.823071+0000","last_peered":"2024-09-16T16:47:43.823071+0000","last_clean":"2024-09-16T16:47:43.823071+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:47:43.823071+0000","last_undegraded":"2024-09-16T16:47:43.823071+0000","last_fullsized":"2024-09-16T16:47:43.823071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":21568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'380","reported_seq":404,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.504753+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:47:43.504753+0000","last_peered":"2024-09-16T16:47:43.504753+0000","last_clean":"2024-09-16T16:47:43.504753+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:47:43.504753+0000","last_undegraded":"2024-09-16T16:47:43.504753+0000","last_fullsized":"2024-09-16T16:47:43.504753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'376","reported_seq":400,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.550630+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:47:43.550630+0000","last_peered":"2024-09-16T16:47:43.550630+0000","last_clean":"2024-09-16T16:47:43.550630+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:47:43.550630+0000","last_undegraded":"2024-09-16T16:47:43.550630+0000","last_fullsized":"2024-09-16T16:47:43.550630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'372","reported_seq":396,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.665793+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:47:43.665793+0000","last_peered":"2024-09-16T16:47:43.665793+0000","last_clean":"2024-09-16T16:47:43.665793+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:47:43.665793+0000","last_undegraded":"2024-09-16T16:47:43.665793+0000","last_fullsized":"2024-09-16T16:47:43.665793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":372,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'403","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.606665+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:47:43.606665+0000","last_peered":"2024-09-16T16:47:43.606665+0000","last_clean":"2024-09-16T16:47:43.606665+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:47:43.606665+0000","last_undegraded":"2024-09-16T16:47:43.606665+0000","last_fullsized":"2024-09-16T16:47:43.606665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'373","reported_seq":397,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.388136+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:47:43.388136+0000","last_peered":"2024-09-16T16:47:43.388136+0000","last_clean":"2024-09-16T16:47:43.388136+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:47:43.388136+0000","last_undegraded":"2024-09-16T16:47:43.388136+0000","last_fullsized":"2024-09-16T16:47:43.388136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'362","reported_seq":386,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.755775+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:47:43.755775+0000","last_peered":"2024-09-16T16:47:43.755775+0000","last_clean":"2024-09-16T16:47:43.755775+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:47:43.755775+0000","last_undegraded":"2024-09-16T16:47:43.755775+0000","last_fullsized":"2024-09-16T16:47:43.755775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'367","reported_seq":391,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.620632+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:47:43.620632+0000","last_peered":"2024-09-16T16:47:43.620632+0000","last_clean":"2024-09-16T16:47:43.620632+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:47:43.620632+0000","last_undegraded":"2024-09-16T16:47:43.620632+0000","last_fullsized":"2024-09-16T16:47:43.620632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":367,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'350","reported_seq":374,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.071657+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:47:43.071657+0000","last_peered":"2024-09-16T16:47:43.071657+0000","last_clean":"2024-09-16T16:47:43.071657+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:47:43.071657+0000","last_undegraded":"2024-09-16T16:47:43.071657+0000","last_fullsized":"2024-09-16T16:47:43.071657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":22400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'393","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.561016+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:47:43.561016+0000","last_peered":"2024-09-16T16:47:43.561016+0000","last_clean":"2024-09-16T16:47:43.561016+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:47:43.561016+0000","last_undegraded":"2024-09-16T16:47:43.561016+0000","last_fullsized":"2024-09-16T16:47:43.561016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'379","reported_seq":403,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.579842+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:47:43.579842+0000","last_peered":"2024-09-16T16:47:43.579842+0000","last_clean":"2024-09-16T16:47:43.579842+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:47:43.579842+0000","last_undegraded":"2024-09-16T16:47:43.579842+0000","last_fullsized":"2024-09-16T16:47:43.579842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'353","reported_seq":377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:43.678239+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:47:43.678239+0000","last_peered":"2024-09-16T16:47:43.678239+0000","last_clean":"2024-09-16T16:47:43.678239+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:47:43.678239+0000","last_undegraded":"2024-09-16T16:47:43.678239+0000","last_fullsized":"2024-09-16T16:47:43.678239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":384040960,"num_objects":5860,"num_object_clones":0,"num_object_copies":17580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5860,"num_write_kb":375040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5860,"ondisk_log_size":5860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211884355584,"internally_reserved":0,"allocated":2327138304,"data_stored":2327138304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":645460,"kb_used_data":645460,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51652268,"statfs":{"total":53552873472,"available":52891922432,"internally_reserved":0,"allocated":660951040,"data_stored":660951040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506824,"kb_used_data":506824,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51790904,"statfs":{"total":53552873472,"available":53033885696,"internally_reserved":0,"allocated":518987776,"data_stored":518987776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555792,"kb_used_data":555792,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741936,"statfs":{"total":53552873472,"available":52983742464,"internally_reserved":0,"allocated":569131008,"data_stored":569131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":518596,"kb_used_data":518596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51779132,"statfs":{"total":53552873472,"available":53021831168,"internally_reserved":0,"allocated":531042304,"data_stored":531042304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52877963264,"internally_reserved":0,"allocated":674910208,"data_stored":674910208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53012148224,"internally_reserved":0,"allocated":540725248,"data_stored":540725248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52971679744,"internally_reserved":0,"allocated":581193728,"data_stored":581193728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53022695424,"internally_reserved":0,"allocated":530178048,"data_stored":530178048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52877832192,"internally_reserved":0,"allocated":675041280,"data_stored":675041280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:07.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 8530 8514 7.71122 7.0625 0.162513 0.129528 2024-09-16T16:48:08.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 8646 8630 7.70462 7.25 0.0714784 0.129663 2024-09-16T16:48:08.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:08.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:08.618+0000 7f4011991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:08.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:08.625+0000 7f4011991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:09.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 8753 8737 7.69029 6.6875 0.0759586 0.129862 2024-09-16T16:48:10.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 8871 8855 7.6859 7.375 0.212528 0.129956 2024-09-16T16:48:10.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:11.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:11.059+0000 7f754ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:11.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:11.066+0000 7f754ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:11.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 8978 8962 7.67221 6.6875 0.0731474 0.130181 2024-09-16T16:48:11.583 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:11.583 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:11.584 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:11.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:11.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:11.738+0000 7fdf6e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:11.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:11.753+0000 7fdf6e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:11.821 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:11.825 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:11.826 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:11.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:11.999+0000 7ff1a0888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:12.014+0000 7ff1a0888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.046 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.052 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:12.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:12.199 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 9096 9080 7.66819 7.375 0.231073 0.13027 2024-09-16T16:48:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:12.228+0000 7fb076f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:12.250+0000 7fb076f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.367 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.367 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:12.367 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:12.367 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:12.367 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:12.368 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.371 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.371 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:12.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:12.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:12.542+0000 7fe877cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:12.557+0000 7fe877cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:12.584 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.588 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:13.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 9212 9196 7.6626 7.25 0.0824855 0.130362 2024-09-16T16:48:13.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:13.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:13.605+0000 7f1160d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:13.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:13.611+0000 7f1160d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:14.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 9321 9305 7.6514 6.8125 0.264411 0.130554 2024-09-16T16:48:15.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 9428 9412 7.63887 6.6875 0.117953 0.130731 2024-09-16T16:48:15.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:15.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:15.986+0000 7fc57d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:15.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:15.994+0000 7fc57d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:16.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 9540 9524 7.63067 7 0.114227 0.13091 2024-09-16T16:48:17.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 9644 9628 7.61635 6.5 0.218612 0.13109 2024-09-16T16:48:17.589 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:17.589 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:17.589 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:17.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:17.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:17.735+0000 7f7dec07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:17.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:17.749+0000 7f7dec07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:17.801 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:17.802 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:17.808 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:17.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:17.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:17.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:17.957+0000 7f7cf0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:17.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:17.968+0000 7f7cf0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:18.000 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:18.000 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:18.000 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:18.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.158+0000 7f9d53b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.169+0000 7f9d53b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:48:18.201195+0000 min lat: 0.0237797 max lat: 0.716542 avg lat: 0.131332 2024-09-16T16:48:18.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:48:18.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 9745 9729 7.60004 6.3125 0.0894464 0.131332 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:18.247 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:18.248 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:18.248 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:18.251 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:18.252 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:18.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:18.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.411+0000 7f5e46b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.425+0000 7f5e46b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.498+0000 7f71214ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:18.508+0000 7f71214ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:18.540 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:18.541 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:18.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:18.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:19.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 9856 9840 7.59185 6.9375 0.0965477 0.131591 2024-09-16T16:48:20.200 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 9953 9937 7.57319 6.0625 0.25443 0.131719 2024-09-16T16:48:20.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:20.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:20.981+0000 7fc4cd87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:20.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:20.988+0000 7fc4cd87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:21.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 10063 10047 7.56477 6.875 0.190629 0.13205 2024-09-16T16:48:22.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 10170 10154 7.55432 6.6875 0.101473 0.132239 2024-09-16T16:48:23.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 10269 10253 7.53824 6.1875 0.365897 0.132493 2024-09-16T16:48:23.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:23.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.469+0000 7ff67005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.477+0000 7ff67005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.547 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:23.547 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:23.547 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:23.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.695+0000 7f70e40fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.707+0000 7f70e40fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:23.800 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:23.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:23.804 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:23.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:23.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.969+0000 7f4f3dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:23.987+0000 7f4f3dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:24.036 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:24.037 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:24.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:24.040 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:24.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:24.179+0000 7faa4246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:24.192+0000 7faa4246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 10377 10361 7.52906 6.75 0.0884776 0.132657 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:24.302 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:24.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:24.306 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:24.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:24.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:24.457+0000 7fe365591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:24.474+0000 7fe365591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.654 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:24.654 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:24.654 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:24.655 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:24.659 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:24.659 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:25.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 10492 10476 7.52513 7.1875 0.0723844 0.132798 2024-09-16T16:48:25.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:26.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:26.044+0000 7fd35f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:26.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:26.053+0000 7fd35f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:26.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 10599 10583 7.5156 6.6875 0.0627712 0.132942 2024-09-16T16:48:27.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 10711 10695 7.5098 7 0.218921 0.133029 2024-09-16T16:48:28.201 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 16 10818 10802 7.50066 6.6875 0.0537491 0.133163 2024-09-16T16:48:28.335 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:28.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:28.439+0000 7fd8dbec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:28.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:28.444+0000 7fd8dbec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1394 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 10818 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 7.50088 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.737547 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 9.125 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 6 2024-09-16T16:48:29.202 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 120 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 11.8008 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 146 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 96 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.13322 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.0762402 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 0.716542 2024-09-16T16:48:29.203 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0237797 2024-09-16T16:48:29.237 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:48:29.661 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:29.661 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:29.661 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:29.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:29.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:29.794+0000 7f13e34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:29.804+0000 7f13e34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:29.857 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:29.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:29.860 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:29.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:30.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.021+0000 7f495ed08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.035+0000 7f495ed08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:30.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:30.063 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:30.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.186+0000 7f8bdb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.202+0000 7f8bdb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:30.253 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:30.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:30.257 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:30.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:30.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.431+0000 7f4115791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.450+0000 7f4115791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.542 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:30.597 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:30.597 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:30.597 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:30.598 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:30.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:30.601 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:30.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.691+0000 7f0881151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:30.697+0000 7f0881151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:33.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:33.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:33.215+0000 7f6d1bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:33.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:33.226+0000 7f6d1bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:35.603 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:35.603 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:35.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:35.715+0000 7f2d76948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:35.726+0000 7f2d756e6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:35.772+0000 7fbce829c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:35.788+0000 7fbce829c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:36.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:36.126 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-16T16:48:35.778961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608436787,"num_objects":9279,"num_object_clones":0,"num_object_copies":27837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9356,"num_write_kb":594708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9330,"ondisk_log_size":9330,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3559256,"kb_used_data":3559256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205631656,"statfs":{"total":214211493888,"available":210566815744,"internally_reserved":0,"allocated":3644678144,"data_stored":3644678144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002423"},"pg_stats":[{"pgid":"3.f","version":"23'577","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.066231+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:48:13.066231+0000","last_peered":"2024-09-16T16:48:13.066231+0000","last_clean":"2024-09-16T16:48:13.066231+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:48:13.066231+0000","last_undegraded":"2024-09-16T16:48:13.066231+0000","last_fullsized":"2024-09-16T16:48:13.066231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37814272,"num_objects":577,"num_object_clones":0,"num_object_copies":1731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":36928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'546","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.687234+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:48:13.687234+0000","last_peered":"2024-09-16T16:48:13.687234+0000","last_clean":"2024-09-16T16:48:13.687234+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:48:13.687234+0000","last_undegraded":"2024-09-16T16:48:13.687234+0000","last_fullsized":"2024-09-16T16:48:13.687234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":34944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'545","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.417740+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:48:13.417740+0000","last_peered":"2024-09-16T16:48:13.417740+0000","last_clean":"2024-09-16T16:48:13.417740+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:48:13.417740+0000","last_undegraded":"2024-09-16T16:48:13.417740+0000","last_fullsized":"2024-09-16T16:48:13.417740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.578041+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:48:13.578041+0000","last_peered":"2024-09-16T16:48:13.578041+0000","last_clean":"2024-09-16T16:48:13.578041+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:48:13.578041+0000","last_undegraded":"2024-09-16T16:48:13.578041+0000","last_fullsized":"2024-09-16T16:48:13.578041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'565","reported_seq":589,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.837861+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:48:13.837861+0000","last_peered":"2024-09-16T16:48:13.837861+0000","last_clean":"2024-09-16T16:48:13.837861+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:48:13.837861+0000","last_undegraded":"2024-09-16T16:48:13.837861+0000","last_fullsized":"2024-09-16T16:48:13.837861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":565,"num_write_kb":36160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'570","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.636445+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:48:13.636445+0000","last_peered":"2024-09-16T16:48:13.636445+0000","last_clean":"2024-09-16T16:48:13.636445+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:48:13.636445+0000","last_undegraded":"2024-09-16T16:48:13.636445+0000","last_fullsized":"2024-09-16T16:48:13.636445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":570,"num_write_kb":36480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'595","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.609404+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:48:13.609404+0000","last_peered":"2024-09-16T16:48:13.609404+0000","last_clean":"2024-09-16T16:48:13.609404+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:48:13.609404+0000","last_undegraded":"2024-09-16T16:48:13.609404+0000","last_fullsized":"2024-09-16T16:48:13.609404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38993920,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":595,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'587","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.324434+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:48:13.324434+0000","last_peered":"2024-09-16T16:48:13.324434+0000","last_clean":"2024-09-16T16:48:13.324434+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:48:13.324434+0000","last_undegraded":"2024-09-16T16:48:13.324434+0000","last_fullsized":"2024-09-16T16:48:13.324434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.266049+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:47:05.266049+0000","last_peered":"2024-09-16T16:47:05.266049+0000","last_clean":"2024-09-16T16:47:05.266049+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:47:05.266049+0000","last_undegraded":"2024-09-16T16:47:05.266049+0000","last_fullsized":"2024-09-16T16:47:05.266049+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.182700+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:47:05.182700+0000","last_peered":"2024-09-16T16:47:05.182700+0000","last_clean":"2024-09-16T16:47:05.182700+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:47:05.182700+0000","last_undegraded":"2024-09-16T16:47:05.182700+0000","last_fullsized":"2024-09-16T16:47:05.182700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'626","reported_seq":650,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.519146+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:48:13.519146+0000","last_peered":"2024-09-16T16:48:13.519146+0000","last_clean":"2024-09-16T16:48:13.519146+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:48:13.519146+0000","last_undegraded":"2024-09-16T16:48:13.519146+0000","last_fullsized":"2024-09-16T16:48:13.519146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.334032+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:47:05.334032+0000","last_peered":"2024-09-16T16:47:05.334032+0000","last_clean":"2024-09-16T16:47:05.334032+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:47:05.334032+0000","last_undegraded":"2024-09-16T16:47:05.334032+0000","last_fullsized":"2024-09-16T16:47:05.334032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'573","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.193605+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:48:13.193605+0000","last_peered":"2024-09-16T16:48:13.193605+0000","last_clean":"2024-09-16T16:48:13.193605+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:48:13.193605+0000","last_undegraded":"2024-09-16T16:48:13.193605+0000","last_fullsized":"2024-09-16T16:48:13.193605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552128,"num_objects":573,"num_object_clones":0,"num_object_copies":1719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":36672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.172743+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:47:05.172743+0000","last_peered":"2024-09-16T16:47:05.172743+0000","last_clean":"2024-09-16T16:47:05.172743+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:47:05.172743+0000","last_undegraded":"2024-09-16T16:47:05.172743+0000","last_fullsized":"2024-09-16T16:47:05.172743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'579","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.609651+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:48:13.609651+0000","last_peered":"2024-09-16T16:48:13.609651+0000","last_clean":"2024-09-16T16:48:13.609651+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:48:13.609651+0000","last_undegraded":"2024-09-16T16:48:13.609651+0000","last_fullsized":"2024-09-16T16:48:13.609651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37945344,"num_objects":579,"num_object_clones":0,"num_object_copies":1737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.327539+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:47:05.327539+0000","last_peered":"2024-09-16T16:47:05.327539+0000","last_clean":"2024-09-16T16:47:05.327539+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:47:05.327539+0000","last_undegraded":"2024-09-16T16:47:05.327539+0000","last_fullsized":"2024-09-16T16:47:05.327539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'585","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.779693+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:48:13.779693+0000","last_peered":"2024-09-16T16:48:13.779693+0000","last_clean":"2024-09-16T16:48:13.779693+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:48:13.779693+0000","last_undegraded":"2024-09-16T16:48:13.779693+0000","last_fullsized":"2024-09-16T16:48:13.779693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'578","reported_seq":602,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.456729+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:48:13.456729+0000","last_peered":"2024-09-16T16:48:13.456729+0000","last_clean":"2024-09-16T16:48:13.456729+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:48:13.456729+0000","last_undegraded":"2024-09-16T16:48:13.456729+0000","last_fullsized":"2024-09-16T16:48:13.456729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.331017+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:47:05.331017+0000","last_peered":"2024-09-16T16:47:05.331017+0000","last_clean":"2024-09-16T16:47:05.331017+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:47:05.331017+0000","last_undegraded":"2024-09-16T16:47:05.331017+0000","last_fullsized":"2024-09-16T16:47:05.331017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'607","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.725628+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:48:13.725628+0000","last_peered":"2024-09-16T16:48:13.725628+0000","last_clean":"2024-09-16T16:48:13.725628+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:48:13.725628+0000","last_undegraded":"2024-09-16T16:48:13.725628+0000","last_fullsized":"2024-09-16T16:48:13.725628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.272478+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:47:05.272478+0000","last_peered":"2024-09-16T16:47:05.272478+0000","last_clean":"2024-09-16T16:47:05.272478+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:47:05.272478+0000","last_undegraded":"2024-09-16T16:47:05.272478+0000","last_fullsized":"2024-09-16T16:47:05.272478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'591","reported_seq":615,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.681711+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:48:13.681711+0000","last_peered":"2024-09-16T16:48:13.681711+0000","last_clean":"2024-09-16T16:48:13.681711+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:48:13.681711+0000","last_undegraded":"2024-09-16T16:48:13.681711+0000","last_fullsized":"2024-09-16T16:48:13.681711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":591,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.325753+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:47:05.325753+0000","last_peered":"2024-09-16T16:47:05.325753+0000","last_clean":"2024-09-16T16:47:05.325753+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:47:05.325753+0000","last_undegraded":"2024-09-16T16:47:05.325753+0000","last_fullsized":"2024-09-16T16:47:05.325753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'573","reported_seq":597,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:48:13.477144+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:48:13.477144+0000","last_peered":"2024-09-16T16:48:13.477144+0000","last_clean":"2024-09-16T16:48:13.477144+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:48:13.477144+0000","last_undegraded":"2024-09-16T16:48:13.477144+0000","last_fullsized":"2024-09-16T16:48:13.477144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552128,"num_objects":573,"num_object_clones":0,"num_object_copies":1719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":36672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T16:47:05.179399+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:47:05.179399+0000","last_peered":"2024-09-16T16:47:05.179399+0000","last_clean":"2024-09-16T16:47:05.179399+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:47:05.179399+0000","last_undegraded":"2024-09-16T16:47:05.179399+0000","last_fullsized":"2024-09-16T16:47:05.179399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":607846400,"num_objects":9275,"num_object_clones":0,"num_object_copies":27825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9275,"num_write_kb":593600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210527133696,"internally_reserved":0,"allocated":3684360192,"data_stored":3684360192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9275,"ondisk_log_size":9275,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210527526912,"internally_reserved":0,"allocated":3683966976,"data_stored":3683966976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52479684608,"internally_reserved":0,"allocated":1073188864,"data_stored":1073188864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1036696,"kb_used_data":1036696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51261032,"statfs":{"total":53552873472,"available":52491296768,"internally_reserved":0,"allocated":1061576704,"data_stored":1061576704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":814276,"kb_used_data":814276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51483452,"statfs":{"total":53552873472,"available":52719054848,"internally_reserved":0,"allocated":833818624,"data_stored":833818624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":887040,"kb_used_data":887040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51410688,"statfs":{"total":53552873472,"available":52644544512,"internally_reserved":0,"allocated":908328960,"data_stored":908328960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":821244,"kb_used_data":821244,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51476484,"statfs":{"total":53552873472,"available":52711919616,"internally_reserved":0,"allocated":840953856,"data_stored":840953856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52479684608,"internally_reserved":0,"allocated":1073188864,"data_stored":1073188864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52703776768,"internally_reserved":0,"allocated":849096704,"data_stored":849096704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52634525696,"internally_reserved":0,"allocated":918347776,"data_stored":918347776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52709801984,"internally_reserved":0,"allocated":843071488,"data_stored":843071488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52479422464,"internally_reserved":0,"allocated":1073451008,"data_stored":1073451008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52703776768,"internally_reserved":0,"allocated":849096704,"data_stored":849096704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52634525696,"internally_reserved":0,"allocated":918347776,"data_stored":918347776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52709670912,"internally_reserved":0,"allocated":843202560,"data_stored":843202560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52479160320,"internally_reserved":0,"allocated":1073713152,"data_stored":1073713152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:38.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:38.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:38.163+0000 7fcf66591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:38.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:38.170+0000 7fcf66591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:40.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:40.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:40.646+0000 7f2c5b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:40.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:40.653+0000 7f2c5b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:41.128 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:41.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:48:41.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:41.281+0000 7ffa23391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:41.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:41.302+0000 7ffa23391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:42.662 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:48:42.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:48:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:42.832+0000 7f6d1dc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:42.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:42.847+0000 7f6d1dc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:42.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:43.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:43.157+0000 7f47fded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:43.164+0000 7f47fded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:48:43.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:48:43.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:43.843+0000 7f5554c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:43.862+0000 7f5554c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:44.672 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:48:44.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:48:44.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:44.850+0000 7fc0b9846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:44.863+0000 7fc0b9846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:45.677 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:48:45.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:45.696+0000 7fc87cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.703 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:48:45.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:45.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:45.707+0000 7fc87cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:45.870+0000 7effb96ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:45.884+0000 7effb96ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.194 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:46.195 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:46.215 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-16T16:48:45.781050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":588186187,"num_objects":8971,"num_object_clones":0,"num_object_copies":26913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12752,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12726,"ondisk_log_size":12726,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3532064,"kb_used_data":3532064,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205658848,"statfs":{"total":214211493888,"available":210594660352,"internally_reserved":0,"allocated":3616833536,"data_stored":3616833536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20250600,"num_objects":-308,"num_object_clones":0,"num_object_copies":-924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3396,"num_write_kb":98753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000804"},"pg_stats":[{"pgid":"3.f","version":"25'781","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.726605+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:48:43.726605+0000","last_peered":"2024-09-16T16:48:43.726605+0000","last_clean":"2024-09-16T16:48:43.726605+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:48:43.726605+0000","last_undegraded":"2024-09-16T16:48:43.726605+0000","last_fullsized":"2024-09-16T16:48:43.726605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.825439+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:48:43.825439+0000","last_peered":"2024-09-16T16:48:43.825439+0000","last_clean":"2024-09-16T16:48:43.825439+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:48:43.825439+0000","last_undegraded":"2024-09-16T16:48:43.825439+0000","last_fullsized":"2024-09-16T16:48:43.825439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'762","reported_seq":793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744078+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:48:43.744078+0000","last_peered":"2024-09-16T16:48:43.744078+0000","last_clean":"2024-09-16T16:48:43.744078+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:48:43.744078+0000","last_undegraded":"2024-09-16T16:48:43.744078+0000","last_fullsized":"2024-09-16T16:48:43.744078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34013208,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'804","reported_seq":834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727866+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:48:43.727866+0000","last_peered":"2024-09-16T16:48:43.727866+0000","last_clean":"2024-09-16T16:48:43.727866+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:48:43.727866+0000","last_undegraded":"2024-09-16T16:48:43.727866+0000","last_fullsized":"2024-09-16T16:48:43.727866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'747","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.703425+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:48:43.703425+0000","last_peered":"2024-09-16T16:48:43.703425+0000","last_clean":"2024-09-16T16:48:43.703425+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:48:43.703425+0000","last_undegraded":"2024-09-16T16:48:43.703425+0000","last_fullsized":"2024-09-16T16:48:43.703425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'764","reported_seq":794,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.719618+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:48:43.719618+0000","last_peered":"2024-09-16T16:48:43.719618+0000","last_clean":"2024-09-16T16:48:43.719618+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:48:43.719618+0000","last_undegraded":"2024-09-16T16:48:43.719618+0000","last_fullsized":"2024-09-16T16:48:43.719618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'809","reported_seq":839,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.724241+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:48:43.724241+0000","last_peered":"2024-09-16T16:48:43.724241+0000","last_clean":"2024-09-16T16:48:43.724241+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:48:43.724241+0000","last_undegraded":"2024-09-16T16:48:43.724241+0000","last_fullsized":"2024-09-16T16:48:43.724241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'803","reported_seq":833,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.746459+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:48:43.746459+0000","last_peered":"2024-09-16T16:48:43.746459+0000","last_clean":"2024-09-16T16:48:43.746459+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:48:43.746459+0000","last_undegraded":"2024-09-16T16:48:43.746459+0000","last_fullsized":"2024-09-16T16:48:43.746459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36634624,"num_objects":559,"num_object_clones":0,"num_object_copies":1677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.693868+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:43.693868+0000","last_peered":"2024-09-16T16:48:43.693868+0000","last_clean":"2024-09-16T16:48:43.693868+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:43.693868+0000","last_undegraded":"2024-09-16T16:48:43.693868+0000","last_fullsized":"2024-09-16T16:48:43.693868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.741234+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:43.741234+0000","last_peered":"2024-09-16T16:48:43.741234+0000","last_clean":"2024-09-16T16:48:43.741234+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:43.741234+0000","last_undegraded":"2024-09-16T16:48:43.741234+0000","last_fullsized":"2024-09-16T16:48:43.741234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'859","reported_seq":889,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744862+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:48:43.744862+0000","last_peered":"2024-09-16T16:48:43.744862+0000","last_clean":"2024-09-16T16:48:43.744862+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:48:43.744862+0000","last_undegraded":"2024-09-16T16:48:43.744862+0000","last_fullsized":"2024-09-16T16:48:43.744862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727850+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:43.727850+0000","last_peered":"2024-09-16T16:48:43.727850+0000","last_clean":"2024-09-16T16:48:43.727850+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:43.727850+0000","last_undegraded":"2024-09-16T16:48:43.727850+0000","last_fullsized":"2024-09-16T16:48:43.727850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'790","reported_seq":820,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.716395+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:48:43.716395+0000","last_peered":"2024-09-16T16:48:43.716395+0000","last_clean":"2024-09-16T16:48:43.716395+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:48:43.716395+0000","last_undegraded":"2024-09-16T16:48:43.716395+0000","last_fullsized":"2024-09-16T16:48:43.716395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.737205+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:43.737205+0000","last_peered":"2024-09-16T16:48:43.737205+0000","last_clean":"2024-09-16T16:48:43.737205+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:43.737205+0000","last_undegraded":"2024-09-16T16:48:43.737205+0000","last_fullsized":"2024-09-16T16:48:43.737205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.729135+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:48:43.729135+0000","last_peered":"2024-09-16T16:48:43.729135+0000","last_clean":"2024-09-16T16:48:43.729135+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:48:43.729135+0000","last_undegraded":"2024-09-16T16:48:43.729135+0000","last_fullsized":"2024-09-16T16:48:43.729135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.730187+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:43.730187+0000","last_peered":"2024-09-16T16:48:43.730187+0000","last_clean":"2024-09-16T16:48:43.730187+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:43.730187+0000","last_undegraded":"2024-09-16T16:48:43.730187+0000","last_fullsized":"2024-09-16T16:48:43.730187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'805","reported_seq":835,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.799590+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:48:43.799590+0000","last_peered":"2024-09-16T16:48:43.799590+0000","last_clean":"2024-09-16T16:48:43.799590+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:48:43.799590+0000","last_undegraded":"2024-09-16T16:48:43.799590+0000","last_fullsized":"2024-09-16T16:48:43.799590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'748","reported_seq":778,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.747317+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:48:43.747317+0000","last_peered":"2024-09-16T16:48:43.747317+0000","last_clean":"2024-09-16T16:48:43.747317+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:48:43.747317+0000","last_undegraded":"2024-09-16T16:48:43.747317+0000","last_fullsized":"2024-09-16T16:48:43.747317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745024+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:43.745024+0000","last_peered":"2024-09-16T16:48:43.745024+0000","last_clean":"2024-09-16T16:48:43.745024+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:43.745024+0000","last_undegraded":"2024-09-16T16:48:43.745024+0000","last_fullsized":"2024-09-16T16:48:43.745024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'822","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.750200+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:48:43.750200+0000","last_peered":"2024-09-16T16:48:43.750200+0000","last_clean":"2024-09-16T16:48:43.750200+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:48:43.750200+0000","last_undegraded":"2024-09-16T16:48:43.750200+0000","last_fullsized":"2024-09-16T16:48:43.750200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37486592,"num_objects":572,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.701494+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:43.701494+0000","last_peered":"2024-09-16T16:48:43.701494+0000","last_clean":"2024-09-16T16:48:43.701494+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:43.701494+0000","last_undegraded":"2024-09-16T16:48:43.701494+0000","last_fullsized":"2024-09-16T16:48:43.701494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'795","reported_seq":825,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.695939+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:48:43.695939+0000","last_peered":"2024-09-16T16:48:43.695939+0000","last_clean":"2024-09-16T16:48:43.695939+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:48:43.695939+0000","last_undegraded":"2024-09-16T16:48:43.695939+0000","last_fullsized":"2024-09-16T16:48:43.695939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.742140+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:43.742140+0000","last_peered":"2024-09-16T16:48:43.742140+0000","last_clean":"2024-09-16T16:48:43.742140+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:43.742140+0000","last_undegraded":"2024-09-16T16:48:43.742140+0000","last_fullsized":"2024-09-16T16:48:43.742140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'812","reported_seq":842,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.748808+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:48:43.748808+0000","last_peered":"2024-09-16T16:48:43.748808+0000","last_clean":"2024-09-16T16:48:43.748808+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:48:43.748808+0000","last_undegraded":"2024-09-16T16:48:43.748808+0000","last_fullsized":"2024-09-16T16:48:43.748808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37224448,"num_objects":568,"num_object_clones":0,"num_object_copies":1704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745606+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:43.745606+0000","last_peered":"2024-09-16T16:48:43.745606+0000","last_clean":"2024-09-16T16:48:43.745606+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:43.745606+0000","last_undegraded":"2024-09-16T16:48:43.745606+0000","last_fullsized":"2024-09-16T16:48:43.745606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":587595800,"num_objects":8967,"num_object_clones":0,"num_object_copies":26901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12671,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635952128,"internally_reserved":0,"allocated":3575541760,"data_stored":3575541760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12671,"ondisk_log_size":12671,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635689984,"internally_reserved":0,"allocated":3575803904,"data_stored":3575803904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1027796,"kb_used_data":1027796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51269932,"statfs":{"total":53552873472,"available":52500410368,"internally_reserved":0,"allocated":1052463104,"data_stored":1052463104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":806672,"kb_used_data":806672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51491056,"statfs":{"total":53552873472,"available":52726841344,"internally_reserved":0,"allocated":826032128,"data_stored":826032128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":881424,"kb_used_data":881424,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51416304,"statfs":{"total":53552873472,"available":52650295296,"internally_reserved":0,"allocated":902578176,"data_stored":902578176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":816172,"kb_used_data":816172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51481556,"statfs":{"total":53552873472,"available":52717113344,"internally_reserved":0,"allocated":835760128,"data_stored":835760128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52659724288,"internally_reserved":0,"allocated":893149184,"data_stored":893149184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52737064960,"internally_reserved":0,"allocated":815808512,"data_stored":815808512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52659855360,"internally_reserved":0,"allocated":893018112,"data_stored":893018112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52737196032,"internally_reserved":0,"allocated":815677440,"data_stored":815677440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:46.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:46.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:46.350+0000 7fe6f4088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:46.360+0000 7fe6f4088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.651 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:46.674 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-16T16:48:45.781050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":588186187,"num_objects":8971,"num_object_clones":0,"num_object_copies":26913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12752,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12726,"ondisk_log_size":12726,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3532064,"kb_used_data":3532064,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205658848,"statfs":{"total":214211493888,"available":210594660352,"internally_reserved":0,"allocated":3616833536,"data_stored":3616833536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20250600,"num_objects":-308,"num_object_clones":0,"num_object_copies":-924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3396,"num_write_kb":98753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000804"},"pg_stats":[{"pgid":"3.f","version":"25'781","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.726605+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:48:43.726605+0000","last_peered":"2024-09-16T16:48:43.726605+0000","last_clean":"2024-09-16T16:48:43.726605+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:48:43.726605+0000","last_undegraded":"2024-09-16T16:48:43.726605+0000","last_fullsized":"2024-09-16T16:48:43.726605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.825439+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:48:43.825439+0000","last_peered":"2024-09-16T16:48:43.825439+0000","last_clean":"2024-09-16T16:48:43.825439+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:48:43.825439+0000","last_undegraded":"2024-09-16T16:48:43.825439+0000","last_fullsized":"2024-09-16T16:48:43.825439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'762","reported_seq":793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744078+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:48:43.744078+0000","last_peered":"2024-09-16T16:48:43.744078+0000","last_clean":"2024-09-16T16:48:43.744078+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:48:43.744078+0000","last_undegraded":"2024-09-16T16:48:43.744078+0000","last_fullsized":"2024-09-16T16:48:43.744078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34013208,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'804","reported_seq":834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727866+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:48:43.727866+0000","last_peered":"2024-09-16T16:48:43.727866+0000","last_clean":"2024-09-16T16:48:43.727866+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:48:43.727866+0000","last_undegraded":"2024-09-16T16:48:43.727866+0000","last_fullsized":"2024-09-16T16:48:43.727866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'747","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.703425+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:48:43.703425+0000","last_peered":"2024-09-16T16:48:43.703425+0000","last_clean":"2024-09-16T16:48:43.703425+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:48:43.703425+0000","last_undegraded":"2024-09-16T16:48:43.703425+0000","last_fullsized":"2024-09-16T16:48:43.703425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'764","reported_seq":794,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.719618+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:48:43.719618+0000","last_peered":"2024-09-16T16:48:43.719618+0000","last_clean":"2024-09-16T16:48:43.719618+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:48:43.719618+0000","last_undegraded":"2024-09-16T16:48:43.719618+0000","last_fullsized":"2024-09-16T16:48:43.719618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'809","reported_seq":839,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.724241+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:48:43.724241+0000","last_peered":"2024-09-16T16:48:43.724241+0000","last_clean":"2024-09-16T16:48:43.724241+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:48:43.724241+0000","last_undegraded":"2024-09-16T16:48:43.724241+0000","last_fullsized":"2024-09-16T16:48:43.724241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'803","reported_seq":833,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.746459+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:48:43.746459+0000","last_peered":"2024-09-16T16:48:43.746459+0000","last_clean":"2024-09-16T16:48:43.746459+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:48:43.746459+0000","last_undegraded":"2024-09-16T16:48:43.746459+0000","last_fullsized":"2024-09-16T16:48:43.746459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36634624,"num_objects":559,"num_object_clones":0,"num_object_copies":1677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.693868+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:43.693868+0000","last_peered":"2024-09-16T16:48:43.693868+0000","last_clean":"2024-09-16T16:48:43.693868+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:43.693868+0000","last_undegraded":"2024-09-16T16:48:43.693868+0000","last_fullsized":"2024-09-16T16:48:43.693868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.741234+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:43.741234+0000","last_peered":"2024-09-16T16:48:43.741234+0000","last_clean":"2024-09-16T16:48:43.741234+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:43.741234+0000","last_undegraded":"2024-09-16T16:48:43.741234+0000","last_fullsized":"2024-09-16T16:48:43.741234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'859","reported_seq":889,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744862+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:48:43.744862+0000","last_peered":"2024-09-16T16:48:43.744862+0000","last_clean":"2024-09-16T16:48:43.744862+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:48:43.744862+0000","last_undegraded":"2024-09-16T16:48:43.744862+0000","last_fullsized":"2024-09-16T16:48:43.744862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727850+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:43.727850+0000","last_peered":"2024-09-16T16:48:43.727850+0000","last_clean":"2024-09-16T16:48:43.727850+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:43.727850+0000","last_undegraded":"2024-09-16T16:48:43.727850+0000","last_fullsized":"2024-09-16T16:48:43.727850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'790","reported_seq":820,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.716395+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:48:43.716395+0000","last_peered":"2024-09-16T16:48:43.716395+0000","last_clean":"2024-09-16T16:48:43.716395+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:48:43.716395+0000","last_undegraded":"2024-09-16T16:48:43.716395+0000","last_fullsized":"2024-09-16T16:48:43.716395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.737205+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:43.737205+0000","last_peered":"2024-09-16T16:48:43.737205+0000","last_clean":"2024-09-16T16:48:43.737205+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:43.737205+0000","last_undegraded":"2024-09-16T16:48:43.737205+0000","last_fullsized":"2024-09-16T16:48:43.737205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.729135+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:48:43.729135+0000","last_peered":"2024-09-16T16:48:43.729135+0000","last_clean":"2024-09-16T16:48:43.729135+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:48:43.729135+0000","last_undegraded":"2024-09-16T16:48:43.729135+0000","last_fullsized":"2024-09-16T16:48:43.729135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.730187+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:43.730187+0000","last_peered":"2024-09-16T16:48:43.730187+0000","last_clean":"2024-09-16T16:48:43.730187+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:43.730187+0000","last_undegraded":"2024-09-16T16:48:43.730187+0000","last_fullsized":"2024-09-16T16:48:43.730187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'805","reported_seq":835,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.799590+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:48:43.799590+0000","last_peered":"2024-09-16T16:48:43.799590+0000","last_clean":"2024-09-16T16:48:43.799590+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:48:43.799590+0000","last_undegraded":"2024-09-16T16:48:43.799590+0000","last_fullsized":"2024-09-16T16:48:43.799590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'748","reported_seq":778,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.747317+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:48:43.747317+0000","last_peered":"2024-09-16T16:48:43.747317+0000","last_clean":"2024-09-16T16:48:43.747317+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:48:43.747317+0000","last_undegraded":"2024-09-16T16:48:43.747317+0000","last_fullsized":"2024-09-16T16:48:43.747317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745024+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:43.745024+0000","last_peered":"2024-09-16T16:48:43.745024+0000","last_clean":"2024-09-16T16:48:43.745024+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:43.745024+0000","last_undegraded":"2024-09-16T16:48:43.745024+0000","last_fullsized":"2024-09-16T16:48:43.745024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'822","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.750200+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:48:43.750200+0000","last_peered":"2024-09-16T16:48:43.750200+0000","last_clean":"2024-09-16T16:48:43.750200+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:48:43.750200+0000","last_undegraded":"2024-09-16T16:48:43.750200+0000","last_fullsized":"2024-09-16T16:48:43.750200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37486592,"num_objects":572,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.701494+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:43.701494+0000","last_peered":"2024-09-16T16:48:43.701494+0000","last_clean":"2024-09-16T16:48:43.701494+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:43.701494+0000","last_undegraded":"2024-09-16T16:48:43.701494+0000","last_fullsized":"2024-09-16T16:48:43.701494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'795","reported_seq":825,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.695939+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:48:43.695939+0000","last_peered":"2024-09-16T16:48:43.695939+0000","last_clean":"2024-09-16T16:48:43.695939+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:48:43.695939+0000","last_undegraded":"2024-09-16T16:48:43.695939+0000","last_fullsized":"2024-09-16T16:48:43.695939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.742140+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:43.742140+0000","last_peered":"2024-09-16T16:48:43.742140+0000","last_clean":"2024-09-16T16:48:43.742140+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:43.742140+0000","last_undegraded":"2024-09-16T16:48:43.742140+0000","last_fullsized":"2024-09-16T16:48:43.742140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'812","reported_seq":842,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.748808+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:48:43.748808+0000","last_peered":"2024-09-16T16:48:43.748808+0000","last_clean":"2024-09-16T16:48:43.748808+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:48:43.748808+0000","last_undegraded":"2024-09-16T16:48:43.748808+0000","last_fullsized":"2024-09-16T16:48:43.748808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37224448,"num_objects":568,"num_object_clones":0,"num_object_copies":1704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745606+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:43.745606+0000","last_peered":"2024-09-16T16:48:43.745606+0000","last_clean":"2024-09-16T16:48:43.745606+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:43.745606+0000","last_undegraded":"2024-09-16T16:48:43.745606+0000","last_fullsized":"2024-09-16T16:48:43.745606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":587595800,"num_objects":8967,"num_object_clones":0,"num_object_copies":26901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12671,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635952128,"internally_reserved":0,"allocated":3575541760,"data_stored":3575541760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12671,"ondisk_log_size":12671,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635689984,"internally_reserved":0,"allocated":3575803904,"data_stored":3575803904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1027796,"kb_used_data":1027796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51269932,"statfs":{"total":53552873472,"available":52500410368,"internally_reserved":0,"allocated":1052463104,"data_stored":1052463104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":806672,"kb_used_data":806672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51491056,"statfs":{"total":53552873472,"available":52726841344,"internally_reserved":0,"allocated":826032128,"data_stored":826032128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":881424,"kb_used_data":881424,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51416304,"statfs":{"total":53552873472,"available":52650295296,"internally_reserved":0,"allocated":902578176,"data_stored":902578176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":816172,"kb_used_data":816172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51481556,"statfs":{"total":53552873472,"available":52717113344,"internally_reserved":0,"allocated":835760128,"data_stored":835760128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52659724288,"internally_reserved":0,"allocated":893149184,"data_stored":893149184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52737064960,"internally_reserved":0,"allocated":815808512,"data_stored":815808512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52659855360,"internally_reserved":0,"allocated":893018112,"data_stored":893018112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52737196032,"internally_reserved":0,"allocated":815677440,"data_stored":815677440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:46.675 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:48:46.676 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:46.676 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:46.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:46.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:46.823+0000 7f59b7aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:46.838+0000 7f59b7aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.863 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:46.864 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:46.867 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:46.867 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:46.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:47.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.014+0000 7f1960591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.026+0000 7f1960591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.054 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:47.054 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:47.054 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:47.055 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:47.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:47.058 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:47.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:47.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.196+0000 7fe9aa69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.207+0000 7fe9aa69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:47.252 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:47.253 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:47.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:47.256 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:47.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:47.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.421+0000 7f145ef48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:47.439+0000 7f145ef48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:47.543 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:47.546 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:47.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:48.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:48.210+0000 7f66eef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:48.218+0000 7f66eef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:50.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:50.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:50.725+0000 7f8b58151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:50.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:50.732+0000 7f8b58151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:52.547 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:52.547 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:52.547 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:52.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:52.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:52.683+0000 7f720ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:52.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:52.700+0000 7f720ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:52.749 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:52.754 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:52.755 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:52.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:52.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:52.892+0000 7fca040fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:52.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:52.903+0000 7fca040fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:52.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:52.939 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:52.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:52.968 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:53.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.083+0000 7fe3c4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.101+0000 7fe3c4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.123 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:53.123 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:53.124 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:53.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:53.128 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:53.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:53.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.144+0000 7f2a15111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.154+0000 7f2a15111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.296+0000 7f36164a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:53.314+0000 7f36164a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:48:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:48:53.384 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:48:53.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:53.387 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:55.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:55.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:55.708+0000 7f5617551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:55.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:55.715+0000 7f5617551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:58.189+0000 7f45966ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:58.196+0000 7f45966ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.387 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:58.388 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:58.388 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:58.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:58.560+0000 7fd2990fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:48:58.572+0000 7fd2990fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.913 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:48:58.913 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:48:58.937 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-16T16:48:57.783459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":588186187,"num_objects":8971,"num_object_clones":0,"num_object_copies":26913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12752,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12726,"ondisk_log_size":12726,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3532064,"kb_used_data":3532064,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205658848,"statfs":{"total":214211493888,"available":210594660352,"internally_reserved":0,"allocated":3616833536,"data_stored":3616833536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002408"},"pg_stats":[{"pgid":"3.f","version":"25'781","reported_seq":811,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.726605+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:48:43.726605+0000","last_peered":"2024-09-16T16:48:43.726605+0000","last_clean":"2024-09-16T16:48:43.726605+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:48:43.726605+0000","last_undegraded":"2024-09-16T16:48:43.726605+0000","last_fullsized":"2024-09-16T16:48:43.726605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.825439+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:48:43.825439+0000","last_peered":"2024-09-16T16:48:43.825439+0000","last_clean":"2024-09-16T16:48:43.825439+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:48:43.825439+0000","last_undegraded":"2024-09-16T16:48:43.825439+0000","last_fullsized":"2024-09-16T16:48:43.825439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'762","reported_seq":793,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744078+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:48:43.744078+0000","last_peered":"2024-09-16T16:48:43.744078+0000","last_clean":"2024-09-16T16:48:43.744078+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:48:43.744078+0000","last_undegraded":"2024-09-16T16:48:43.744078+0000","last_fullsized":"2024-09-16T16:48:43.744078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34013208,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'804","reported_seq":834,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727866+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:48:43.727866+0000","last_peered":"2024-09-16T16:48:43.727866+0000","last_clean":"2024-09-16T16:48:43.727866+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:48:43.727866+0000","last_undegraded":"2024-09-16T16:48:43.727866+0000","last_fullsized":"2024-09-16T16:48:43.727866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'747","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.703425+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:48:43.703425+0000","last_peered":"2024-09-16T16:48:43.703425+0000","last_clean":"2024-09-16T16:48:43.703425+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:48:43.703425+0000","last_undegraded":"2024-09-16T16:48:43.703425+0000","last_fullsized":"2024-09-16T16:48:43.703425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'764","reported_seq":794,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.719618+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:48:43.719618+0000","last_peered":"2024-09-16T16:48:43.719618+0000","last_clean":"2024-09-16T16:48:43.719618+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:48:43.719618+0000","last_undegraded":"2024-09-16T16:48:43.719618+0000","last_fullsized":"2024-09-16T16:48:43.719618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'809","reported_seq":839,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.724241+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:48:43.724241+0000","last_peered":"2024-09-16T16:48:43.724241+0000","last_clean":"2024-09-16T16:48:43.724241+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:48:43.724241+0000","last_undegraded":"2024-09-16T16:48:43.724241+0000","last_fullsized":"2024-09-16T16:48:43.724241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'803","reported_seq":833,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.746459+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:48:43.746459+0000","last_peered":"2024-09-16T16:48:43.746459+0000","last_clean":"2024-09-16T16:48:43.746459+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:48:43.746459+0000","last_undegraded":"2024-09-16T16:48:43.746459+0000","last_fullsized":"2024-09-16T16:48:43.746459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36634624,"num_objects":559,"num_object_clones":0,"num_object_copies":1677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.693868+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:43.693868+0000","last_peered":"2024-09-16T16:48:43.693868+0000","last_clean":"2024-09-16T16:48:43.693868+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:43.693868+0000","last_undegraded":"2024-09-16T16:48:43.693868+0000","last_fullsized":"2024-09-16T16:48:43.693868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.741234+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:43.741234+0000","last_peered":"2024-09-16T16:48:43.741234+0000","last_clean":"2024-09-16T16:48:43.741234+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:43.741234+0000","last_undegraded":"2024-09-16T16:48:43.741234+0000","last_fullsized":"2024-09-16T16:48:43.741234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'859","reported_seq":889,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.744862+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:48:43.744862+0000","last_peered":"2024-09-16T16:48:43.744862+0000","last_clean":"2024-09-16T16:48:43.744862+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:48:43.744862+0000","last_undegraded":"2024-09-16T16:48:43.744862+0000","last_fullsized":"2024-09-16T16:48:43.744862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.727850+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:43.727850+0000","last_peered":"2024-09-16T16:48:43.727850+0000","last_clean":"2024-09-16T16:48:43.727850+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:43.727850+0000","last_undegraded":"2024-09-16T16:48:43.727850+0000","last_fullsized":"2024-09-16T16:48:43.727850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'790","reported_seq":820,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.716395+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:48:43.716395+0000","last_peered":"2024-09-16T16:48:43.716395+0000","last_clean":"2024-09-16T16:48:43.716395+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:48:43.716395+0000","last_undegraded":"2024-09-16T16:48:43.716395+0000","last_fullsized":"2024-09-16T16:48:43.716395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.737205+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:43.737205+0000","last_peered":"2024-09-16T16:48:43.737205+0000","last_clean":"2024-09-16T16:48:43.737205+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:43.737205+0000","last_undegraded":"2024-09-16T16:48:43.737205+0000","last_fullsized":"2024-09-16T16:48:43.737205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'785","reported_seq":815,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.729135+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:48:43.729135+0000","last_peered":"2024-09-16T16:48:43.729135+0000","last_clean":"2024-09-16T16:48:43.729135+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:48:43.729135+0000","last_undegraded":"2024-09-16T16:48:43.729135+0000","last_fullsized":"2024-09-16T16:48:43.729135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.730187+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:43.730187+0000","last_peered":"2024-09-16T16:48:43.730187+0000","last_clean":"2024-09-16T16:48:43.730187+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:43.730187+0000","last_undegraded":"2024-09-16T16:48:43.730187+0000","last_fullsized":"2024-09-16T16:48:43.730187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'805","reported_seq":835,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.799590+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:48:43.799590+0000","last_peered":"2024-09-16T16:48:43.799590+0000","last_clean":"2024-09-16T16:48:43.799590+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:48:43.799590+0000","last_undegraded":"2024-09-16T16:48:43.799590+0000","last_fullsized":"2024-09-16T16:48:43.799590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'748","reported_seq":778,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.747317+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:48:43.747317+0000","last_peered":"2024-09-16T16:48:43.747317+0000","last_clean":"2024-09-16T16:48:43.747317+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:48:43.747317+0000","last_undegraded":"2024-09-16T16:48:43.747317+0000","last_fullsized":"2024-09-16T16:48:43.747317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745024+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:43.745024+0000","last_peered":"2024-09-16T16:48:43.745024+0000","last_clean":"2024-09-16T16:48:43.745024+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:43.745024+0000","last_undegraded":"2024-09-16T16:48:43.745024+0000","last_fullsized":"2024-09-16T16:48:43.745024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'822","reported_seq":852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.750200+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:48:43.750200+0000","last_peered":"2024-09-16T16:48:43.750200+0000","last_clean":"2024-09-16T16:48:43.750200+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:48:43.750200+0000","last_undegraded":"2024-09-16T16:48:43.750200+0000","last_fullsized":"2024-09-16T16:48:43.750200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37486592,"num_objects":572,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.701494+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:43.701494+0000","last_peered":"2024-09-16T16:48:43.701494+0000","last_clean":"2024-09-16T16:48:43.701494+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:43.701494+0000","last_undegraded":"2024-09-16T16:48:43.701494+0000","last_fullsized":"2024-09-16T16:48:43.701494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'795","reported_seq":825,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.695939+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:48:43.695939+0000","last_peered":"2024-09-16T16:48:43.695939+0000","last_clean":"2024-09-16T16:48:43.695939+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:48:43.695939+0000","last_undegraded":"2024-09-16T16:48:43.695939+0000","last_fullsized":"2024-09-16T16:48:43.695939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.742140+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:43.742140+0000","last_peered":"2024-09-16T16:48:43.742140+0000","last_clean":"2024-09-16T16:48:43.742140+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:43.742140+0000","last_undegraded":"2024-09-16T16:48:43.742140+0000","last_fullsized":"2024-09-16T16:48:43.742140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'812","reported_seq":842,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.748808+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:48:43.748808+0000","last_peered":"2024-09-16T16:48:43.748808+0000","last_clean":"2024-09-16T16:48:43.748808+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:48:43.748808+0000","last_undegraded":"2024-09-16T16:48:43.748808+0000","last_fullsized":"2024-09-16T16:48:43.748808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37224448,"num_objects":568,"num_object_clones":0,"num_object_copies":1704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T16:48:43.745606+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:43.745606+0000","last_peered":"2024-09-16T16:48:43.745606+0000","last_clean":"2024-09-16T16:48:43.745606+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:43.745606+0000","last_undegraded":"2024-09-16T16:48:43.745606+0000","last_fullsized":"2024-09-16T16:48:43.745606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":587595800,"num_objects":8967,"num_object_clones":0,"num_object_copies":26901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12671,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635952128,"internally_reserved":0,"allocated":3575541760,"data_stored":3575541760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12671,"ondisk_log_size":12671,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210635689984,"internally_reserved":0,"allocated":3575803904,"data_stored":3575803904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1027796,"kb_used_data":1027796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51269932,"statfs":{"total":53552873472,"available":52500410368,"internally_reserved":0,"allocated":1052463104,"data_stored":1052463104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":806672,"kb_used_data":806672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51491056,"statfs":{"total":53552873472,"available":52726841344,"internally_reserved":0,"allocated":826032128,"data_stored":826032128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":881424,"kb_used_data":881424,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51416304,"statfs":{"total":53552873472,"available":52650295296,"internally_reserved":0,"allocated":902578176,"data_stored":902578176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":816172,"kb_used_data":816172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51481556,"statfs":{"total":53552873472,"available":52717113344,"internally_reserved":0,"allocated":835760128,"data_stored":835760128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52512874496,"internally_reserved":0,"allocated":1039998976,"data_stored":1039998976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52659724288,"internally_reserved":0,"allocated":893149184,"data_stored":893149184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52737064960,"internally_reserved":0,"allocated":815808512,"data_stored":815808512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":52725895168,"internally_reserved":0,"allocated":826978304,"data_stored":826978304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":52659855360,"internally_reserved":0,"allocated":893018112,"data_stored":893018112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":52737196032,"internally_reserved":0,"allocated":815677440,"data_stored":815677440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52513005568,"internally_reserved":0,"allocated":1039867904,"data_stored":1039867904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:00.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:00.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:00.608+0000 7fa8d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:00.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:00.616+0000 7fa8d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:03.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:03.091+0000 7ff211351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:03.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:03.099+0000 7ff211351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:03.939 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:03.939 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:03.940 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:03.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:04.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.102+0000 7f0530511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.119+0000 7f0530511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:04.143 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:04.144 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:04.150 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:04.150 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:04.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:04.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.298+0000 7f9942c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.316+0000 7f9942c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.343 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:04.343 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:04.343 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:04.344 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:04.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:04.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:04.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:04.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.490+0000 7f5a4bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.502+0000 7f5a4bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:04.549 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:04.552 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:04.552 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:04.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:04.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.713+0000 7f5902a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:04.730+0000 7f5902a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:04.838 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:04.843 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:04.843 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:05.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:05.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:05.582+0000 7f2125a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:05.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:05.589+0000 7f2125a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:07.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:07.904+0000 7f09b6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:07.912+0000 7f09b6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:09.844 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:09.844 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:09.845 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:09.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:09.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:09.987+0000 7fd0f1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.001+0000 7fd0f1551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:10.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:10.034 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:10.037 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:10.037 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:10.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:10.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.176+0000 7fbb01ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.192+0000 7fbb01ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:10.239 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:10.240 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:10.240 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:10.240 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:10.240 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:10.245 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:10.245 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:10.245 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:10.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.328+0000 7f2ec4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.338+0000 7f2ec4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.447+0000 7fc962391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.465+0000 7fc962391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:10.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:10.492 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:10.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:10.496 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:10.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:10.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.640+0000 7f6a974d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:10.657+0000 7f6a974d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:10.693 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:10.696 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:10.697 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:12.596 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:12.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:12.742+0000 7f5649aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:12.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:12.749+0000 7f5649aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:15.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:15.234+0000 7fb5e7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:15.240+0000 7fb5e7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.697 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:15.697 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:15.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:15.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:15.839+0000 7fceb306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:15.851+0000 7fceb306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:16.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:16.170 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:16.188 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-09-16T16:49:15.787479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-238288896,"num_objects":-3636,"num_object_clones":0,"num_object_copies":-10908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3636,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002673"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:17.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:17.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:17.692+0000 7effc909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:17.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:17.702+0000 7effc909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:19.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:20.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:20.044+0000 7f8fd5f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:20.052+0000 7f8fd5f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:21.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:21.191 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:21.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:21.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:21.342+0000 7f6e6a111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:21.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:21.352+0000 7f6e6a111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:21.721 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:21.743 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-16T16:49:19.788348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-238288896,"num_objects":-3636,"num_object_clones":0,"num_object_copies":-10908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3636,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:22.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:22.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:22.461+0000 7ff231d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:22.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:22.469+0000 7ff231d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:24.820+0000 7f3879d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:24.826+0000 7f3879d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:26.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:26.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:26.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:26.876+0000 7f6426751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:26.889+0000 7f6426751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:27.171 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:27.172 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:27.193 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T16:49:25.789512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-116129792,"num_objects":-1772,"num_object_clones":0,"num_object_copies":-5316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1772,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002567"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:27.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:27.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:27.399+0000 7f2baa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:27.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:27.407+0000 7f2ba972f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:29.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:29.833+0000 7ffac6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:29.843+0000 7ffac6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:32.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:32.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:32.195 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:32.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:32.327+0000 7f83c0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:32.340+0000 7f83bf32f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:32.379+0000 7fba1beac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:32.388+0000 7fba1beac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:32.754 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-16T16:49:31.790684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002336"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:34.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:34.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:34.842+0000 7fcf47391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:34.854+0000 7fcf47391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:37.304 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:37.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:37.452+0000 7f63e9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:37.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:37.461+0000 7f63e9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:37.756 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:37.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:49:37.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:37.906+0000 7f5cbd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:37.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:37.926+0000 7f5cbd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:38.864 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:49:38.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:49:39.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:39.021+0000 7f64d1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:39.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:39.040+0000 7f64d1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:39.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:49:39.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:49:40.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:40.010+0000 7f486b8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:40.017+0000 7f486b8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:40.087+0000 7f83c8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:40.107+0000 7f83c8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.877 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:49:40.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:49:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:41.038+0000 7f328b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:41.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:41.049+0000 7f328b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:49:41.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:49:41.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:42.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.032+0000 7f0b03551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.041+0000 7f0b03551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.245 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:42.245 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:42.261 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T16:49:41.890155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098318"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:42.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:42.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:42.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.393+0000 7f5212551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.402+0000 7f5212551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.504+0000 7f91b3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.510+0000 7f91b3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.703 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:42.704 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:42.718 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T16:49:41.890155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098318"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:42.719 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:49:42.720 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:42.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.905+0000 7f9210aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:42.915+0000 7f9210aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:43.212 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:43.213 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:43.231 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T16:49:41.890155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":349897291,"num_objects":5335,"num_object_clones":0,"num_object_copies":16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16388,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16362,"ondisk_log_size":16362,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2135144,"kb_used_data":2135144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207055768,"statfs":{"total":214211493888,"available":212025106432,"internally_reserved":0,"allocated":2186387456,"data_stored":2186387456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.098318"},"pg_stats":[{"pgid":"3.f","version":"27'1020","reported_seq":1056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.597196+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:13.597196+0000","last_peered":"2024-09-16T16:49:13.597196+0000","last_clean":"2024-09-16T16:49:13.597196+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:13.597196+0000","last_undegraded":"2024-09-16T16:49:13.597196+0000","last_fullsized":"2024-09-16T16:49:13.597196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1020,"log_dups_size":0,"ondisk_log_size":1020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1020,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"27'972","reported_seq":1008,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.825839+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:13.825839+0000","last_peered":"2024-09-16T16:49:13.825839+0000","last_clean":"2024-09-16T16:49:13.825839+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:13.825839+0000","last_undegraded":"2024-09-16T16:49:13.825839+0000","last_fullsized":"2024-09-16T16:49:13.825839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'966","reported_seq":1003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.285881+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:13.285881+0000","last_peered":"2024-09-16T16:49:13.285881+0000","last_clean":"2024-09-16T16:49:13.285881+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:13.285881+0000","last_undegraded":"2024-09-16T16:49:13.285881+0000","last_fullsized":"2024-09-16T16:49:13.285881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643864,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":966,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'1035","reported_seq":1071,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.454430+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:13.454430+0000","last_peered":"2024-09-16T16:49:13.454430+0000","last_clean":"2024-09-16T16:49:13.454430+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:13.454430+0000","last_undegraded":"2024-09-16T16:49:13.454430+0000","last_fullsized":"2024-09-16T16:49:13.454430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1035,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'958","reported_seq":994,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.604533+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:13.604533+0000","last_peered":"2024-09-16T16:49:13.604533+0000","last_clean":"2024-09-16T16:49:13.604533+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:13.604533+0000","last_undegraded":"2024-09-16T16:49:13.604533+0000","last_fullsized":"2024-09-16T16:49:13.604533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'1010","reported_seq":1046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.141674+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:13.141674+0000","last_peered":"2024-09-16T16:49:13.141674+0000","last_clean":"2024-09-16T16:49:13.141674+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:13.141674+0000","last_undegraded":"2024-09-16T16:49:13.141674+0000","last_fullsized":"2024-09-16T16:49:13.141674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'1048","reported_seq":1084,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.637639+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:13.637639+0000","last_peered":"2024-09-16T16:49:13.637639+0000","last_clean":"2024-09-16T16:49:13.637639+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:13.637639+0000","last_undegraded":"2024-09-16T16:49:13.637639+0000","last_fullsized":"2024-09-16T16:49:13.637639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'1027","reported_seq":1063,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.578620+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:13.578620+0000","last_peered":"2024-09-16T16:49:13.578620+0000","last_clean":"2024-09-16T16:49:13.578620+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:13.578620+0000","last_undegraded":"2024-09-16T16:49:13.578620+0000","last_fullsized":"2024-09-16T16:49:13.578620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1027,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.719730+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:48:45.719730+0000","last_peered":"2024-09-16T16:48:45.719730+0000","last_clean":"2024-09-16T16:48:45.719730+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:48:45.719730+0000","last_undegraded":"2024-09-16T16:48:45.719730+0000","last_fullsized":"2024-09-16T16:48:45.719730+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.779909+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:48:45.779909+0000","last_peered":"2024-09-16T16:48:45.779909+0000","last_clean":"2024-09-16T16:48:45.779909+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:48:45.779909+0000","last_undegraded":"2024-09-16T16:48:45.779909+0000","last_fullsized":"2024-09-16T16:48:45.779909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"27'1109","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.660923+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:13.660923+0000","last_peered":"2024-09-16T16:49:13.660923+0000","last_clean":"2024-09-16T16:49:13.660923+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:13.660923+0000","last_undegraded":"2024-09-16T16:49:13.660923+0000","last_fullsized":"2024-09-16T16:49:13.660923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.824049+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:48:45.824049+0000","last_peered":"2024-09-16T16:48:45.824049+0000","last_clean":"2024-09-16T16:48:45.824049+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:48:45.824049+0000","last_undegraded":"2024-09-16T16:48:45.824049+0000","last_fullsized":"2024-09-16T16:48:45.824049+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'1018","reported_seq":1054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.536310+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:13.536310+0000","last_peered":"2024-09-16T16:49:13.536310+0000","last_clean":"2024-09-16T16:49:13.536310+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:13.536310+0000","last_undegraded":"2024-09-16T16:49:13.536310+0000","last_fullsized":"2024-09-16T16:49:13.536310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.772565+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:48:45.772565+0000","last_peered":"2024-09-16T16:48:45.772565+0000","last_clean":"2024-09-16T16:48:45.772565+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:48:45.772565+0000","last_undegraded":"2024-09-16T16:48:45.772565+0000","last_fullsized":"2024-09-16T16:48:45.772565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1011","reported_seq":1047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.635709+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:13.635709+0000","last_peered":"2024-09-16T16:49:13.635709+0000","last_clean":"2024-09-16T16:49:13.635709+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:13.635709+0000","last_undegraded":"2024-09-16T16:49:13.635709+0000","last_fullsized":"2024-09-16T16:49:13.635709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.828502+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:48:45.828502+0000","last_peered":"2024-09-16T16:48:45.828502+0000","last_clean":"2024-09-16T16:48:45.828502+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:48:45.828502+0000","last_undegraded":"2024-09-16T16:48:45.828502+0000","last_fullsized":"2024-09-16T16:48:45.828502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'1028","reported_seq":1064,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.785894+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:13.785894+0000","last_peered":"2024-09-16T16:49:13.785894+0000","last_clean":"2024-09-16T16:49:13.785894+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:13.785894+0000","last_undegraded":"2024-09-16T16:49:13.785894+0000","last_fullsized":"2024-09-16T16:49:13.785894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"27'979","reported_seq":1015,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.245695+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:13.245695+0000","last_peered":"2024-09-16T16:49:13.245695+0000","last_clean":"2024-09-16T16:49:13.245695+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:13.245695+0000","last_undegraded":"2024-09-16T16:49:13.245695+0000","last_fullsized":"2024-09-16T16:49:13.245695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.710436+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:48:45.710436+0000","last_peered":"2024-09-16T16:48:45.710436+0000","last_clean":"2024-09-16T16:48:45.710436+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:48:45.710436+0000","last_undegraded":"2024-09-16T16:48:45.710436+0000","last_fullsized":"2024-09-16T16:48:45.710436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"27'1065","reported_seq":1101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.781768+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:13.781768+0000","last_peered":"2024-09-16T16:49:13.781768+0000","last_clean":"2024-09-16T16:49:13.781768+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:13.781768+0000","last_undegraded":"2024-09-16T16:49:13.781768+0000","last_fullsized":"2024-09-16T16:49:13.781768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.726350+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:48:45.726350+0000","last_peered":"2024-09-16T16:48:45.726350+0000","last_clean":"2024-09-16T16:48:45.726350+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:48:45.726350+0000","last_undegraded":"2024-09-16T16:48:45.726350+0000","last_fullsized":"2024-09-16T16:48:45.726350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"27'1038","reported_seq":1074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.463936+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:13.463936+0000","last_peered":"2024-09-16T16:49:13.463936+0000","last_clean":"2024-09-16T16:49:13.463936+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:13.463936+0000","last_undegraded":"2024-09-16T16:49:13.463936+0000","last_fullsized":"2024-09-16T16:49:13.463936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1038,"log_dups_size":0,"ondisk_log_size":1038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1038,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.708506+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:48:45.708506+0000","last_peered":"2024-09-16T16:48:45.708506+0000","last_clean":"2024-09-16T16:48:45.708506+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:48:45.708506+0000","last_undegraded":"2024-09-16T16:48:45.708506+0000","last_fullsized":"2024-09-16T16:48:45.708506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:49:13.830412+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:13.830412+0000","last_peered":"2024-09-16T16:49:13.830412+0000","last_clean":"2024-09-16T16:49:13.830412+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:13.830412+0000","last_undegraded":"2024-09-16T16:49:13.830412+0000","last_fullsized":"2024-09-16T16:49:13.830412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T16:48:45.778084+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:48:45.778084+0000","last_peered":"2024-09-16T16:48:45.778084+0000","last_clean":"2024-09-16T16:48:45.778084+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:48:45.778084+0000","last_undegraded":"2024-09-16T16:48:45.778084+0000","last_fullsized":"2024-09-16T16:48:45.778084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":349306904,"num_objects":5331,"num_object_clones":0,"num_object_copies":15993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16307,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064514048,"internally_reserved":0,"allocated":2146979840,"data_stored":2146979840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16307,"ondisk_log_size":16307,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212064382976,"internally_reserved":0,"allocated":2147110912,"data_stored":2147110912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":624416,"kb_used_data":624416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51673312,"statfs":{"total":53552873472,"available":52913471488,"internally_reserved":0,"allocated":639401984,"data_stored":639401984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489720,"kb_used_data":489720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808008,"statfs":{"total":53552873472,"available":53051400192,"internally_reserved":0,"allocated":501473280,"data_stored":501473280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532284,"kb_used_data":532284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51765444,"statfs":{"total":53552873472,"available":53007814656,"internally_reserved":0,"allocated":545058816,"data_stored":545058816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":488724,"kb_used_data":488724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51809004,"statfs":{"total":53552873472,"available":53052420096,"internally_reserved":0,"allocated":500453376,"data_stored":500453376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52925841408,"internally_reserved":0,"allocated":627032064,"data_stored":627032064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52926234624,"internally_reserved":0,"allocated":626638848,"data_stored":626638848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53061148672,"internally_reserved":0,"allocated":491724800,"data_stored":491724800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53017411584,"internally_reserved":0,"allocated":535461888,"data_stored":535461888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53059588096,"internally_reserved":0,"allocated":493285376,"data_stored":493285376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":52926365696,"internally_reserved":0,"allocated":626507776,"data_stored":626507776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:44.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:44.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:44.907+0000 7f442acf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:44.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:44.914+0000 7f442acf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:47.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:47.344+0000 7fd352308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:47.354+0000 7fd352308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:48.234 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:48.234 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:48.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:48.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:48.358+0000 7f33142bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:48.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:48.370+0000 7f33142bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:48.630 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:48.630 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:48.645 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-16T16:49:47.794105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137036363,"num_objects":2087,"num_object_clones":0,"num_object_copies":6261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19636,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19610,"ondisk_log_size":19610,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":868600,"kb_used_data":868600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208322312,"statfs":{"total":214211493888,"available":213322047488,"internally_reserved":0,"allocated":889446400,"data_stored":889446400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212860928,"num_objects":-3248,"num_object_clones":0,"num_object_copies":-9744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.922249"},"pg_stats":[{"pgid":"3.f","version":"31'1224","reported_seq":1272,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.582139+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:43.582139+0000","last_peered":"2024-09-16T16:49:43.582139+0000","last_clean":"2024-09-16T16:49:43.582139+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:43.582139+0000","last_undegraded":"2024-09-16T16:49:43.582139+0000","last_fullsized":"2024-09-16T16:49:43.582139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1224,"log_dups_size":0,"ondisk_log_size":1224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'1170","reported_seq":1218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.586234+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:43.586234+0000","last_peered":"2024-09-16T16:49:43.586234+0000","last_clean":"2024-09-16T16:49:43.586234+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:43.586234+0000","last_undegraded":"2024-09-16T16:49:43.586234+0000","last_fullsized":"2024-09-16T16:49:43.586234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'1154","reported_seq":1203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.567753+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:43.567753+0000","last_peered":"2024-09-16T16:49:43.567753+0000","last_clean":"2024-09-16T16:49:43.567753+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:43.567753+0000","last_undegraded":"2024-09-16T16:49:43.567753+0000","last_fullsized":"2024-09-16T16:49:43.567753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323096,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1154,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'1227","reported_seq":1275,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.602819+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:43.602819+0000","last_peered":"2024-09-16T16:49:43.602819+0000","last_clean":"2024-09-16T16:49:43.602819+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:43.602819+0000","last_undegraded":"2024-09-16T16:49:43.602819+0000","last_fullsized":"2024-09-16T16:49:43.602819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1172","reported_seq":1220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.514050+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:43.514050+0000","last_peered":"2024-09-16T16:49:43.514050+0000","last_clean":"2024-09-16T16:49:43.514050+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:43.514050+0000","last_undegraded":"2024-09-16T16:49:43.514050+0000","last_fullsized":"2024-09-16T16:49:43.514050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'1185","reported_seq":1233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:42.865754+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:42.865754+0000","last_peered":"2024-09-16T16:49:42.865754+0000","last_clean":"2024-09-16T16:49:42.865754+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:42.865754+0000","last_undegraded":"2024-09-16T16:49:42.865754+0000","last_fullsized":"2024-09-16T16:49:42.865754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1261","reported_seq":1309,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.678535+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:43.678535+0000","last_peered":"2024-09-16T16:49:43.678535+0000","last_clean":"2024-09-16T16:49:43.678535+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:43.678535+0000","last_undegraded":"2024-09-16T16:49:43.678535+0000","last_fullsized":"2024-09-16T16:49:43.678535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1261,"log_dups_size":0,"ondisk_log_size":1261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.286603+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:43.286603+0000","last_peered":"2024-09-16T16:49:43.286603+0000","last_clean":"2024-09-16T16:49:43.286603+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:43.286603+0000","last_undegraded":"2024-09-16T16:49:43.286603+0000","last_fullsized":"2024-09-16T16:49:43.286603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.974217+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:49:41.974217+0000","last_peered":"2024-09-16T16:49:41.974217+0000","last_clean":"2024-09-16T16:49:41.974217+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:49:41.974217+0000","last_undegraded":"2024-09-16T16:49:41.974217+0000","last_fullsized":"2024-09-16T16:49:41.974217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.978508+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:49:41.978508+0000","last_peered":"2024-09-16T16:49:41.978508+0000","last_clean":"2024-09-16T16:49:41.978508+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:49:41.978508+0000","last_undegraded":"2024-09-16T16:49:41.978508+0000","last_fullsized":"2024-09-16T16:49:41.978508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1325","reported_seq":1373,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.496193+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:43.496193+0000","last_peered":"2024-09-16T16:49:43.496193+0000","last_clean":"2024-09-16T16:49:43.496193+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:43.496193+0000","last_undegraded":"2024-09-16T16:49:43.496193+0000","last_fullsized":"2024-09-16T16:49:43.496193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1325,"log_dups_size":0,"ondisk_log_size":1325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.973891+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:49:41.973891+0000","last_peered":"2024-09-16T16:49:41.973891+0000","last_clean":"2024-09-16T16:49:41.973891+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:49:41.973891+0000","last_undegraded":"2024-09-16T16:49:41.973891+0000","last_fullsized":"2024-09-16T16:49:41.973891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1204","reported_seq":1252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.804180+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:43.804180+0000","last_peered":"2024-09-16T16:49:43.804180+0000","last_clean":"2024-09-16T16:49:43.804180+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:43.804180+0000","last_undegraded":"2024-09-16T16:49:43.804180+0000","last_fullsized":"2024-09-16T16:49:43.804180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.970184+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:49:41.970184+0000","last_peered":"2024-09-16T16:49:41.970184+0000","last_clean":"2024-09-16T16:49:41.970184+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:49:41.970184+0000","last_undegraded":"2024-09-16T16:49:41.970184+0000","last_fullsized":"2024-09-16T16:49:41.970184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1214","reported_seq":1262,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.666119+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:43.666119+0000","last_peered":"2024-09-16T16:49:43.666119+0000","last_clean":"2024-09-16T16:49:43.666119+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:43.666119+0000","last_undegraded":"2024-09-16T16:49:43.666119+0000","last_fullsized":"2024-09-16T16:49:43.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.972625+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:49:41.972625+0000","last_peered":"2024-09-16T16:49:41.972625+0000","last_clean":"2024-09-16T16:49:41.972625+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:49:41.972625+0000","last_undegraded":"2024-09-16T16:49:41.972625+0000","last_fullsized":"2024-09-16T16:49:41.972625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.757501+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:43.757501+0000","last_peered":"2024-09-16T16:49:43.757501+0000","last_clean":"2024-09-16T16:49:43.757501+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:43.757501+0000","last_undegraded":"2024-09-16T16:49:43.757501+0000","last_fullsized":"2024-09-16T16:49:43.757501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'1194","reported_seq":1242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.511648+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:43.511648+0000","last_peered":"2024-09-16T16:49:43.511648+0000","last_clean":"2024-09-16T16:49:43.511648+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:43.511648+0000","last_undegraded":"2024-09-16T16:49:43.511648+0000","last_fullsized":"2024-09-16T16:49:43.511648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.961494+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:49:41.961494+0000","last_peered":"2024-09-16T16:49:41.961494+0000","last_clean":"2024-09-16T16:49:41.961494+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:49:41.961494+0000","last_undegraded":"2024-09-16T16:49:41.961494+0000","last_fullsized":"2024-09-16T16:49:41.961494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'1277","reported_seq":1325,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.276285+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:43.276285+0000","last_peered":"2024-09-16T16:49:43.276285+0000","last_clean":"2024-09-16T16:49:43.276285+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:43.276285+0000","last_undegraded":"2024-09-16T16:49:43.276285+0000","last_fullsized":"2024-09-16T16:49:43.276285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1277,"log_dups_size":0,"ondisk_log_size":1277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.980234+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:49:41.980234+0000","last_peered":"2024-09-16T16:49:41.980234+0000","last_clean":"2024-09-16T16:49:41.980234+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:49:41.980234+0000","last_undegraded":"2024-09-16T16:49:41.980234+0000","last_fullsized":"2024-09-16T16:49:41.980234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'1252","reported_seq":1300,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.643498+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:43.643498+0000","last_peered":"2024-09-16T16:49:43.643498+0000","last_clean":"2024-09-16T16:49:43.643498+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:43.643498+0000","last_undegraded":"2024-09-16T16:49:43.643498+0000","last_fullsized":"2024-09-16T16:49:43.643498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.953838+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:49:41.953838+0000","last_peered":"2024-09-16T16:49:41.953838+0000","last_clean":"2024-09-16T16:49:41.953838+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:49:41.953838+0000","last_undegraded":"2024-09-16T16:49:41.953838+0000","last_fullsized":"2024-09-16T16:49:41.953838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1226","reported_seq":1274,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.781710+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:43.781710+0000","last_peered":"2024-09-16T16:49:43.781710+0000","last_clean":"2024-09-16T16:49:43.781710+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:43.781710+0000","last_undegraded":"2024-09-16T16:49:43.781710+0000","last_fullsized":"2024-09-16T16:49:43.781710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.975906+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:49:41.975906+0000","last_peered":"2024-09-16T16:49:41.975906+0000","last_clean":"2024-09-16T16:49:41.975906+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:49:41.975906+0000","last_undegraded":"2024-09-16T16:49:41.975906+0000","last_fullsized":"2024-09-16T16:49:41.975906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":136445976,"num_objects":2083,"num_object_clones":0,"num_object_copies":6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19555,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347160064,"internally_reserved":0,"allocated":864333824,"data_stored":864333824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19555,"ondisk_log_size":19555,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347028992,"internally_reserved":0,"allocated":864464896,"data_stored":864464896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253404,"kb_used_data":253404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044324,"statfs":{"total":53552873472,"available":53293387776,"internally_reserved":0,"allocated":259485696,"data_stored":259485696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":198576,"kb_used_data":198576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52099152,"statfs":{"total":53552873472,"available":53349531648,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217328,"kb_used_data":217328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080400,"statfs":{"total":53552873472,"available":53330329600,"internally_reserved":0,"allocated":222543872,"data_stored":222543872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":199292,"kb_used_data":199292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52098436,"statfs":{"total":53552873472,"available":53348798464,"internally_reserved":0,"allocated":204075008,"data_stored":204075008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53301628928,"internally_reserved":0,"allocated":251244544,"data_stored":251244544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:49.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:49.811+0000 7f47b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:49.818+0000 7f47b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:52.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:52.246+0000 7fd864cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:52.256+0000 7fd864cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:53.647 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:53.647 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:53.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:53.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:53.824+0000 7f84a8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:53.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:53.840+0000 7f84a8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:54.161 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:49:54.162 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:49:54.181 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-16T16:49:53.795377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137036363,"num_objects":2087,"num_object_clones":0,"num_object_copies":6261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19636,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19610,"ondisk_log_size":19610,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":868600,"kb_used_data":868600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208322312,"statfs":{"total":214211493888,"available":213322047488,"internally_reserved":0,"allocated":889446400,"data_stored":889446400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212860928,"num_objects":-3248,"num_object_clones":0,"num_object_copies":-9744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3248,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.905221"},"pg_stats":[{"pgid":"3.f","version":"31'1224","reported_seq":1272,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.582139+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:43.582139+0000","last_peered":"2024-09-16T16:49:43.582139+0000","last_clean":"2024-09-16T16:49:43.582139+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:43.582139+0000","last_undegraded":"2024-09-16T16:49:43.582139+0000","last_fullsized":"2024-09-16T16:49:43.582139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1224,"log_dups_size":0,"ondisk_log_size":1224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'1170","reported_seq":1218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.586234+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:43.586234+0000","last_peered":"2024-09-16T16:49:43.586234+0000","last_clean":"2024-09-16T16:49:43.586234+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:43.586234+0000","last_undegraded":"2024-09-16T16:49:43.586234+0000","last_fullsized":"2024-09-16T16:49:43.586234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'1154","reported_seq":1203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.567753+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:43.567753+0000","last_peered":"2024-09-16T16:49:43.567753+0000","last_clean":"2024-09-16T16:49:43.567753+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:43.567753+0000","last_undegraded":"2024-09-16T16:49:43.567753+0000","last_fullsized":"2024-09-16T16:49:43.567753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323096,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1154,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'1227","reported_seq":1275,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.602819+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:43.602819+0000","last_peered":"2024-09-16T16:49:43.602819+0000","last_clean":"2024-09-16T16:49:43.602819+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:43.602819+0000","last_undegraded":"2024-09-16T16:49:43.602819+0000","last_fullsized":"2024-09-16T16:49:43.602819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1172","reported_seq":1220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.514050+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:43.514050+0000","last_peered":"2024-09-16T16:49:43.514050+0000","last_clean":"2024-09-16T16:49:43.514050+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:43.514050+0000","last_undegraded":"2024-09-16T16:49:43.514050+0000","last_fullsized":"2024-09-16T16:49:43.514050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'1185","reported_seq":1233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:42.865754+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:42.865754+0000","last_peered":"2024-09-16T16:49:42.865754+0000","last_clean":"2024-09-16T16:49:42.865754+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:42.865754+0000","last_undegraded":"2024-09-16T16:49:42.865754+0000","last_fullsized":"2024-09-16T16:49:42.865754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1261","reported_seq":1309,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.678535+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:43.678535+0000","last_peered":"2024-09-16T16:49:43.678535+0000","last_clean":"2024-09-16T16:49:43.678535+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:43.678535+0000","last_undegraded":"2024-09-16T16:49:43.678535+0000","last_fullsized":"2024-09-16T16:49:43.678535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1261,"log_dups_size":0,"ondisk_log_size":1261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.286603+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:43.286603+0000","last_peered":"2024-09-16T16:49:43.286603+0000","last_clean":"2024-09-16T16:49:43.286603+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:43.286603+0000","last_undegraded":"2024-09-16T16:49:43.286603+0000","last_fullsized":"2024-09-16T16:49:43.286603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.974217+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:49:41.974217+0000","last_peered":"2024-09-16T16:49:41.974217+0000","last_clean":"2024-09-16T16:49:41.974217+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:49:41.974217+0000","last_undegraded":"2024-09-16T16:49:41.974217+0000","last_fullsized":"2024-09-16T16:49:41.974217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.978508+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:49:41.978508+0000","last_peered":"2024-09-16T16:49:41.978508+0000","last_clean":"2024-09-16T16:49:41.978508+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:49:41.978508+0000","last_undegraded":"2024-09-16T16:49:41.978508+0000","last_fullsized":"2024-09-16T16:49:41.978508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1325","reported_seq":1373,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.496193+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:43.496193+0000","last_peered":"2024-09-16T16:49:43.496193+0000","last_clean":"2024-09-16T16:49:43.496193+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:43.496193+0000","last_undegraded":"2024-09-16T16:49:43.496193+0000","last_fullsized":"2024-09-16T16:49:43.496193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1325,"log_dups_size":0,"ondisk_log_size":1325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.973891+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:49:41.973891+0000","last_peered":"2024-09-16T16:49:41.973891+0000","last_clean":"2024-09-16T16:49:41.973891+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:49:41.973891+0000","last_undegraded":"2024-09-16T16:49:41.973891+0000","last_fullsized":"2024-09-16T16:49:41.973891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1204","reported_seq":1252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.804180+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:43.804180+0000","last_peered":"2024-09-16T16:49:43.804180+0000","last_clean":"2024-09-16T16:49:43.804180+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:43.804180+0000","last_undegraded":"2024-09-16T16:49:43.804180+0000","last_fullsized":"2024-09-16T16:49:43.804180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.970184+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:49:41.970184+0000","last_peered":"2024-09-16T16:49:41.970184+0000","last_clean":"2024-09-16T16:49:41.970184+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:49:41.970184+0000","last_undegraded":"2024-09-16T16:49:41.970184+0000","last_fullsized":"2024-09-16T16:49:41.970184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1214","reported_seq":1262,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.666119+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:43.666119+0000","last_peered":"2024-09-16T16:49:43.666119+0000","last_clean":"2024-09-16T16:49:43.666119+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:43.666119+0000","last_undegraded":"2024-09-16T16:49:43.666119+0000","last_fullsized":"2024-09-16T16:49:43.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.972625+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:49:41.972625+0000","last_peered":"2024-09-16T16:49:41.972625+0000","last_clean":"2024-09-16T16:49:41.972625+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:49:41.972625+0000","last_undegraded":"2024-09-16T16:49:41.972625+0000","last_fullsized":"2024-09-16T16:49:41.972625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.757501+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:43.757501+0000","last_peered":"2024-09-16T16:49:43.757501+0000","last_clean":"2024-09-16T16:49:43.757501+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:43.757501+0000","last_undegraded":"2024-09-16T16:49:43.757501+0000","last_fullsized":"2024-09-16T16:49:43.757501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'1194","reported_seq":1242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.511648+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:43.511648+0000","last_peered":"2024-09-16T16:49:43.511648+0000","last_clean":"2024-09-16T16:49:43.511648+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:43.511648+0000","last_undegraded":"2024-09-16T16:49:43.511648+0000","last_fullsized":"2024-09-16T16:49:43.511648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.961494+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:49:41.961494+0000","last_peered":"2024-09-16T16:49:41.961494+0000","last_clean":"2024-09-16T16:49:41.961494+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:49:41.961494+0000","last_undegraded":"2024-09-16T16:49:41.961494+0000","last_fullsized":"2024-09-16T16:49:41.961494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'1277","reported_seq":1325,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.276285+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:43.276285+0000","last_peered":"2024-09-16T16:49:43.276285+0000","last_clean":"2024-09-16T16:49:43.276285+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:43.276285+0000","last_undegraded":"2024-09-16T16:49:43.276285+0000","last_fullsized":"2024-09-16T16:49:43.276285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1277,"log_dups_size":0,"ondisk_log_size":1277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.980234+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:49:41.980234+0000","last_peered":"2024-09-16T16:49:41.980234+0000","last_clean":"2024-09-16T16:49:41.980234+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:49:41.980234+0000","last_undegraded":"2024-09-16T16:49:41.980234+0000","last_fullsized":"2024-09-16T16:49:41.980234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'1252","reported_seq":1300,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.643498+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:43.643498+0000","last_peered":"2024-09-16T16:49:43.643498+0000","last_clean":"2024-09-16T16:49:43.643498+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:43.643498+0000","last_undegraded":"2024-09-16T16:49:43.643498+0000","last_fullsized":"2024-09-16T16:49:43.643498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.953838+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:49:41.953838+0000","last_peered":"2024-09-16T16:49:41.953838+0000","last_clean":"2024-09-16T16:49:41.953838+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:49:41.953838+0000","last_undegraded":"2024-09-16T16:49:41.953838+0000","last_fullsized":"2024-09-16T16:49:41.953838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1226","reported_seq":1274,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.781710+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:43.781710+0000","last_peered":"2024-09-16T16:49:43.781710+0000","last_clean":"2024-09-16T16:49:43.781710+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:43.781710+0000","last_undegraded":"2024-09-16T16:49:43.781710+0000","last_fullsized":"2024-09-16T16:49:43.781710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.975906+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:49:41.975906+0000","last_peered":"2024-09-16T16:49:41.975906+0000","last_clean":"2024-09-16T16:49:41.975906+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:49:41.975906+0000","last_undegraded":"2024-09-16T16:49:41.975906+0000","last_fullsized":"2024-09-16T16:49:41.975906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":136445976,"num_objects":2083,"num_object_clones":0,"num_object_copies":6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19555,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347160064,"internally_reserved":0,"allocated":864333824,"data_stored":864333824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19555,"ondisk_log_size":19555,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347028992,"internally_reserved":0,"allocated":864464896,"data_stored":864464896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253404,"kb_used_data":253404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044324,"statfs":{"total":53552873472,"available":53293387776,"internally_reserved":0,"allocated":259485696,"data_stored":259485696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":198576,"kb_used_data":198576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52099152,"statfs":{"total":53552873472,"available":53349531648,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217328,"kb_used_data":217328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080400,"statfs":{"total":53552873472,"available":53330329600,"internally_reserved":0,"allocated":222543872,"data_stored":222543872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":199292,"kb_used_data":199292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52098436,"statfs":{"total":53552873472,"available":53348798464,"internally_reserved":0,"allocated":204075008,"data_stored":204075008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53301628928,"internally_reserved":0,"allocated":251244544,"data_stored":251244544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:54.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:54.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:54.653+0000 7faefdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:54.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:54.660+0000 7faefdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:57.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:57.146+0000 7f5b8cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:57.154+0000 7f5b8cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.184 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:59.184 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:59.184 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:59.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:59.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.319+0000 7f5baded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.330+0000 7f5baded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:59.353 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:59.353 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:59.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:59.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.499+0000 7f268f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.517+0000 7f268f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:59.558 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:59.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:59.562 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:59.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:59.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.705+0000 7f4cd4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.722+0000 7f4cd4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.764+0000 7f29eeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.775+0000 7f29eeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.783 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:59.784 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:59.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:59.788 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:59.789 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:59.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.941+0000 7fe67b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:49:59.958+0000 7fe67b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:49:59.990 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:49:59.991 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:49:59.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:59.994 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:02.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:02.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:02.332+0000 7f02ca0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:02.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:02.339+0000 7f02ca0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:03.781 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 10818 objects 2024-09-16T16:50:03.781 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :94.5434 2024-09-16T16:50:04.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:04.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:04.595+0000 7efe3ea4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:04.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:04.601+0000 7efe3ea4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:04.994 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:04.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:04.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:05.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:05.098+0000 7faa0dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:05.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:05.105+0000 7faa0dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:05.291 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:05.303 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-16T16:50:03.797410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137036363,"num_objects":2087,"num_object_clones":0,"num_object_copies":6261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19636,"num_write_kb":693461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19610,"ondisk_log_size":19610,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":868600,"kb_used_data":868600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208322312,"statfs":{"total":214211493888,"available":213322047488,"internally_reserved":0,"allocated":889446400,"data_stored":889446400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"3.f","version":"31'1224","reported_seq":1272,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.582139+0000","last_change":"2024-09-16T16:46:57.246043+0000","last_active":"2024-09-16T16:49:43.582139+0000","last_peered":"2024-09-16T16:49:43.582139+0000","last_clean":"2024-09-16T16:49:43.582139+0000","last_became_active":"2024-09-16T16:46:57.234566+0000","last_became_peered":"2024-09-16T16:46:57.234566+0000","last_unstale":"2024-09-16T16:49:43.582139+0000","last_undegraded":"2024-09-16T16:49:43.582139+0000","last_fullsized":"2024-09-16T16:49:43.582139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1224,"log_dups_size":0,"ondisk_log_size":1224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"31'1170","reported_seq":1218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.586234+0000","last_change":"2024-09-16T16:46:57.346071+0000","last_active":"2024-09-16T16:49:43.586234+0000","last_peered":"2024-09-16T16:49:43.586234+0000","last_clean":"2024-09-16T16:49:43.586234+0000","last_became_active":"2024-09-16T16:46:57.308571+0000","last_became_peered":"2024-09-16T16:46:57.308571+0000","last_unstale":"2024-09-16T16:49:43.586234+0000","last_undegraded":"2024-09-16T16:49:43.586234+0000","last_fullsized":"2024-09-16T16:49:43.586234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1170,"log_dups_size":0,"ondisk_log_size":1170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'1154","reported_seq":1203,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.567753+0000","last_change":"2024-09-16T16:46:57.322738+0000","last_active":"2024-09-16T16:49:43.567753+0000","last_peered":"2024-09-16T16:49:43.567753+0000","last_clean":"2024-09-16T16:49:43.567753+0000","last_became_active":"2024-09-16T16:46:57.316201+0000","last_became_peered":"2024-09-16T16:46:57.316201+0000","last_unstale":"2024-09-16T16:49:43.567753+0000","last_undegraded":"2024-09-16T16:49:43.567753+0000","last_fullsized":"2024-09-16T16:49:43.567753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323096,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1154,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"31'1227","reported_seq":1275,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.602819+0000","last_change":"2024-09-16T16:46:57.266233+0000","last_active":"2024-09-16T16:49:43.602819+0000","last_peered":"2024-09-16T16:49:43.602819+0000","last_clean":"2024-09-16T16:49:43.602819+0000","last_became_active":"2024-09-16T16:46:57.258299+0000","last_became_peered":"2024-09-16T16:46:57.258299+0000","last_unstale":"2024-09-16T16:49:43.602819+0000","last_undegraded":"2024-09-16T16:49:43.602819+0000","last_fullsized":"2024-09-16T16:49:43.602819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'1172","reported_seq":1220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.514050+0000","last_change":"2024-09-16T16:46:57.263840+0000","last_active":"2024-09-16T16:49:43.514050+0000","last_peered":"2024-09-16T16:49:43.514050+0000","last_clean":"2024-09-16T16:49:43.514050+0000","last_became_active":"2024-09-16T16:46:57.240599+0000","last_became_peered":"2024-09-16T16:46:57.240599+0000","last_unstale":"2024-09-16T16:49:43.514050+0000","last_undegraded":"2024-09-16T16:49:43.514050+0000","last_fullsized":"2024-09-16T16:49:43.514050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1172,"log_dups_size":0,"ondisk_log_size":1172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1172,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"31'1185","reported_seq":1233,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:42.865754+0000","last_change":"2024-09-16T16:46:57.359012+0000","last_active":"2024-09-16T16:49:42.865754+0000","last_peered":"2024-09-16T16:49:42.865754+0000","last_clean":"2024-09-16T16:49:42.865754+0000","last_became_active":"2024-09-16T16:46:57.324927+0000","last_became_peered":"2024-09-16T16:46:57.324927+0000","last_unstale":"2024-09-16T16:49:42.865754+0000","last_undegraded":"2024-09-16T16:49:42.865754+0000","last_fullsized":"2024-09-16T16:49:42.865754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"31'1261","reported_seq":1309,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.678535+0000","last_change":"2024-09-16T16:46:57.351346+0000","last_active":"2024-09-16T16:49:43.678535+0000","last_peered":"2024-09-16T16:49:43.678535+0000","last_clean":"2024-09-16T16:49:43.678535+0000","last_became_active":"2024-09-16T16:46:57.342837+0000","last_became_peered":"2024-09-16T16:46:57.342837+0000","last_unstale":"2024-09-16T16:49:43.678535+0000","last_undegraded":"2024-09-16T16:49:43.678535+0000","last_fullsized":"2024-09-16T16:49:43.678535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1261,"log_dups_size":0,"ondisk_log_size":1261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":44736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.286603+0000","last_change":"2024-09-16T16:46:57.319415+0000","last_active":"2024-09-16T16:49:43.286603+0000","last_peered":"2024-09-16T16:49:43.286603+0000","last_clean":"2024-09-16T16:49:43.286603+0000","last_became_active":"2024-09-16T16:46:57.293534+0000","last_became_peered":"2024-09-16T16:46:57.293534+0000","last_unstale":"2024-09-16T16:49:43.286603+0000","last_undegraded":"2024-09-16T16:49:43.286603+0000","last_fullsized":"2024-09-16T16:49:43.286603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.974217+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:49:41.974217+0000","last_peered":"2024-09-16T16:49:41.974217+0000","last_clean":"2024-09-16T16:49:41.974217+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:49:41.974217+0000","last_undegraded":"2024-09-16T16:49:41.974217+0000","last_fullsized":"2024-09-16T16:49:41.974217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.978508+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:49:41.978508+0000","last_peered":"2024-09-16T16:49:41.978508+0000","last_clean":"2024-09-16T16:49:41.978508+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:49:41.978508+0000","last_undegraded":"2024-09-16T16:49:41.978508+0000","last_fullsized":"2024-09-16T16:49:41.978508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'1325","reported_seq":1373,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.496193+0000","last_change":"2024-09-16T16:46:57.229900+0000","last_active":"2024-09-16T16:49:43.496193+0000","last_peered":"2024-09-16T16:49:43.496193+0000","last_clean":"2024-09-16T16:49:43.496193+0000","last_became_active":"2024-09-16T16:46:57.212722+0000","last_became_peered":"2024-09-16T16:46:57.212722+0000","last_unstale":"2024-09-16T16:49:43.496193+0000","last_undegraded":"2024-09-16T16:49:43.496193+0000","last_fullsized":"2024-09-16T16:49:43.496193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1325,"log_dups_size":0,"ondisk_log_size":1325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":46784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.973891+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:49:41.973891+0000","last_peered":"2024-09-16T16:49:41.973891+0000","last_clean":"2024-09-16T16:49:41.973891+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:49:41.973891+0000","last_undegraded":"2024-09-16T16:49:41.973891+0000","last_fullsized":"2024-09-16T16:49:41.973891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'1204","reported_seq":1252,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.804180+0000","last_change":"2024-09-16T16:46:57.259547+0000","last_active":"2024-09-16T16:49:43.804180+0000","last_peered":"2024-09-16T16:49:43.804180+0000","last_clean":"2024-09-16T16:49:43.804180+0000","last_became_active":"2024-09-16T16:46:57.232574+0000","last_became_peered":"2024-09-16T16:46:57.232574+0000","last_unstale":"2024-09-16T16:49:43.804180+0000","last_undegraded":"2024-09-16T16:49:43.804180+0000","last_fullsized":"2024-09-16T16:49:43.804180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1204,"num_write_kb":42944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.970184+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:49:41.970184+0000","last_peered":"2024-09-16T16:49:41.970184+0000","last_clean":"2024-09-16T16:49:41.970184+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:49:41.970184+0000","last_undegraded":"2024-09-16T16:49:41.970184+0000","last_fullsized":"2024-09-16T16:49:41.970184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'1214","reported_seq":1262,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.666119+0000","last_change":"2024-09-16T16:46:57.307964+0000","last_active":"2024-09-16T16:49:43.666119+0000","last_peered":"2024-09-16T16:49:43.666119+0000","last_clean":"2024-09-16T16:49:43.666119+0000","last_became_active":"2024-09-16T16:46:57.286969+0000","last_became_peered":"2024-09-16T16:46:57.286969+0000","last_unstale":"2024-09-16T16:49:43.666119+0000","last_undegraded":"2024-09-16T16:49:43.666119+0000","last_fullsized":"2024-09-16T16:49:43.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.972625+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:49:41.972625+0000","last_peered":"2024-09-16T16:49:41.972625+0000","last_clean":"2024-09-16T16:49:41.972625+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:49:41.972625+0000","last_undegraded":"2024-09-16T16:49:41.972625+0000","last_fullsized":"2024-09-16T16:49:41.972625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'1235","reported_seq":1283,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.757501+0000","last_change":"2024-09-16T16:46:57.271164+0000","last_active":"2024-09-16T16:49:43.757501+0000","last_peered":"2024-09-16T16:49:43.757501+0000","last_clean":"2024-09-16T16:49:43.757501+0000","last_became_active":"2024-09-16T16:46:57.233925+0000","last_became_peered":"2024-09-16T16:46:57.233925+0000","last_unstale":"2024-09-16T16:49:43.757501+0000","last_undegraded":"2024-09-16T16:49:43.757501+0000","last_fullsized":"2024-09-16T16:49:43.757501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":43776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"31'1194","reported_seq":1242,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.511648+0000","last_change":"2024-09-16T16:46:57.307248+0000","last_active":"2024-09-16T16:49:43.511648+0000","last_peered":"2024-09-16T16:49:43.511648+0000","last_clean":"2024-09-16T16:49:43.511648+0000","last_became_active":"2024-09-16T16:46:57.284484+0000","last_became_peered":"2024-09-16T16:46:57.284484+0000","last_unstale":"2024-09-16T16:49:43.511648+0000","last_undegraded":"2024-09-16T16:49:43.511648+0000","last_fullsized":"2024-09-16T16:49:43.511648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.961494+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:49:41.961494+0000","last_peered":"2024-09-16T16:49:41.961494+0000","last_clean":"2024-09-16T16:49:41.961494+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:49:41.961494+0000","last_undegraded":"2024-09-16T16:49:41.961494+0000","last_fullsized":"2024-09-16T16:49:41.961494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"31'1277","reported_seq":1325,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.276285+0000","last_change":"2024-09-16T16:46:57.333269+0000","last_active":"2024-09-16T16:49:43.276285+0000","last_peered":"2024-09-16T16:49:43.276285+0000","last_clean":"2024-09-16T16:49:43.276285+0000","last_became_active":"2024-09-16T16:46:57.295412+0000","last_became_peered":"2024-09-16T16:46:57.295412+0000","last_unstale":"2024-09-16T16:49:43.276285+0000","last_undegraded":"2024-09-16T16:49:43.276285+0000","last_fullsized":"2024-09-16T16:49:43.276285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1277,"log_dups_size":0,"ondisk_log_size":1277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":44608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.980234+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:49:41.980234+0000","last_peered":"2024-09-16T16:49:41.980234+0000","last_clean":"2024-09-16T16:49:41.980234+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:49:41.980234+0000","last_undegraded":"2024-09-16T16:49:41.980234+0000","last_fullsized":"2024-09-16T16:49:41.980234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'1252","reported_seq":1300,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.643498+0000","last_change":"2024-09-16T16:46:57.312545+0000","last_active":"2024-09-16T16:49:43.643498+0000","last_peered":"2024-09-16T16:49:43.643498+0000","last_clean":"2024-09-16T16:49:43.643498+0000","last_became_active":"2024-09-16T16:46:57.291675+0000","last_became_peered":"2024-09-16T16:46:57.291675+0000","last_unstale":"2024-09-16T16:49:43.643498+0000","last_undegraded":"2024-09-16T16:49:43.643498+0000","last_fullsized":"2024-09-16T16:49:43.643498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.953838+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:49:41.953838+0000","last_peered":"2024-09-16T16:49:41.953838+0000","last_clean":"2024-09-16T16:49:41.953838+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:49:41.953838+0000","last_undegraded":"2024-09-16T16:49:41.953838+0000","last_fullsized":"2024-09-16T16:49:41.953838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'1226","reported_seq":1274,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:43.781710+0000","last_change":"2024-09-16T16:46:57.353093+0000","last_active":"2024-09-16T16:49:43.781710+0000","last_peered":"2024-09-16T16:49:43.781710+0000","last_clean":"2024-09-16T16:49:43.781710+0000","last_became_active":"2024-09-16T16:46:57.319540+0000","last_became_peered":"2024-09-16T16:46:57.319540+0000","last_unstale":"2024-09-16T16:49:43.781710+0000","last_undegraded":"2024-09-16T16:49:43.781710+0000","last_fullsized":"2024-09-16T16:49:43.781710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:56.099414+0000","last_clean_scrub_stamp":"2024-09-16T16:46:56.099414+0000","objects_scrubbed":0,"log_size":1226,"log_dups_size":0,"ondisk_log_size":1226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":44160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.975906+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:49:41.975906+0000","last_peered":"2024-09-16T16:49:41.975906+0000","last_clean":"2024-09-16T16:49:41.975906+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:49:41.975906+0000","last_undegraded":"2024-09-16T16:49:41.975906+0000","last_fullsized":"2024-09-16T16:49:41.975906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":136445976,"num_objects":2083,"num_object_clones":0,"num_object_copies":6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19555,"num_write_kb":692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347160064,"internally_reserved":0,"allocated":864333824,"data_stored":864333824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19555,"ondisk_log_size":19555,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347028992,"internally_reserved":0,"allocated":864464896,"data_stored":864464896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253404,"kb_used_data":253404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044324,"statfs":{"total":53552873472,"available":53293387776,"internally_reserved":0,"allocated":259485696,"data_stored":259485696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":198576,"kb_used_data":198576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52099152,"statfs":{"total":53552873472,"available":53349531648,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217328,"kb_used_data":217328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080400,"statfs":{"total":53552873472,"available":53330329600,"internally_reserved":0,"allocated":222543872,"data_stored":222543872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":199292,"kb_used_data":199292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52098436,"statfs":{"total":53552873472,"available":53348798464,"internally_reserved":0,"allocated":204075008,"data_stored":204075008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53301628928,"internally_reserved":0,"allocated":251244544,"data_stored":251244544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:06.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:06.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:06.814+0000 7ff46c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:06.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:06.819+0000 7ff46c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:07.266 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-16T16:50:07.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-16T16:50:07.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:07.371+0000 7f1779351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:07.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:07.383+0000 7f1779351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:07.689 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_0' removed 2024-09-16T16:50:07.711 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:50:07.712 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:50:07.712 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-16T16:50:07.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-16T16:50:07.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:07.878+0000 7f93d20d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:07.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:07.892+0000 7f93d20d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.696 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_1' created 2024-09-16T16:50:08.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:08.851+0000 7f7333ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:08.866+0000 7f7333ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:09.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:09.038+0000 7f9ce6148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:09.043+0000 7f9ce6148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.697 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-16T16:50:10.306 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:10.306 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:10.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:10.410+0000 7f1ba9a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:10.418+0000 7f1ba9a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:10.601 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:10.602 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:10.614 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-16T16:50:09.798708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":868600,"kb_used_data":868600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208322312,"statfs":{"total":214211493888,"available":213322047488,"internally_reserved":0,"allocated":889446400,"data_stored":889446400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-136445976,"num_objects":-2083,"num_object_clones":0,"num_object_copies":-6249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-19555,"num_write_kb":-692353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001297"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.974217+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:49:41.974217+0000","last_peered":"2024-09-16T16:49:41.974217+0000","last_clean":"2024-09-16T16:49:41.974217+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:49:41.974217+0000","last_undegraded":"2024-09-16T16:49:41.974217+0000","last_fullsized":"2024-09-16T16:49:41.974217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.978508+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:49:41.978508+0000","last_peered":"2024-09-16T16:49:41.978508+0000","last_clean":"2024-09-16T16:49:41.978508+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:49:41.978508+0000","last_undegraded":"2024-09-16T16:49:41.978508+0000","last_fullsized":"2024-09-16T16:49:41.978508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.973891+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:49:41.973891+0000","last_peered":"2024-09-16T16:49:41.973891+0000","last_clean":"2024-09-16T16:49:41.973891+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:49:41.973891+0000","last_undegraded":"2024-09-16T16:49:41.973891+0000","last_fullsized":"2024-09-16T16:49:41.973891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.970184+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:49:41.970184+0000","last_peered":"2024-09-16T16:49:41.970184+0000","last_clean":"2024-09-16T16:49:41.970184+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:49:41.970184+0000","last_undegraded":"2024-09-16T16:49:41.970184+0000","last_fullsized":"2024-09-16T16:49:41.970184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.972625+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:49:41.972625+0000","last_peered":"2024-09-16T16:49:41.972625+0000","last_clean":"2024-09-16T16:49:41.972625+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:49:41.972625+0000","last_undegraded":"2024-09-16T16:49:41.972625+0000","last_fullsized":"2024-09-16T16:49:41.972625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.961494+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:49:41.961494+0000","last_peered":"2024-09-16T16:49:41.961494+0000","last_clean":"2024-09-16T16:49:41.961494+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:49:41.961494+0000","last_undegraded":"2024-09-16T16:49:41.961494+0000","last_fullsized":"2024-09-16T16:49:41.961494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.980234+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:49:41.980234+0000","last_peered":"2024-09-16T16:49:41.980234+0000","last_clean":"2024-09-16T16:49:41.980234+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:49:41.980234+0000","last_undegraded":"2024-09-16T16:49:41.980234+0000","last_fullsized":"2024-09-16T16:49:41.980234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.953838+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:49:41.953838+0000","last_peered":"2024-09-16T16:49:41.953838+0000","last_clean":"2024-09-16T16:49:41.953838+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:49:41.953838+0000","last_undegraded":"2024-09-16T16:49:41.953838+0000","last_fullsized":"2024-09-16T16:49:41.953838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:08.692666+0000","last_change":"2024-09-16T16:50:08.692666+0000","last_active":"2024-09-16T16:50:08.692666+0000","last_peered":"2024-09-16T16:50:08.692666+0000","last_clean":"2024-09-16T16:50:08.692666+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:08.692666+0000","last_undegraded":"2024-09-16T16:50:08.692666+0000","last_fullsized":"2024-09-16T16:50:08.692666+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T16:49:41.975906+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:49:41.975906+0000","last_peered":"2024-09-16T16:49:41.975906+0000","last_clean":"2024-09-16T16:49:41.975906+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:49:41.975906+0000","last_undegraded":"2024-09-16T16:49:41.975906+0000","last_fullsized":"2024-09-16T16:49:41.975906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213347028992,"internally_reserved":0,"allocated":864464896,"data_stored":864464896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":253404,"kb_used_data":253404,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52044324,"statfs":{"total":53552873472,"available":53293387776,"internally_reserved":0,"allocated":259485696,"data_stored":259485696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":198576,"kb_used_data":198576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52099152,"statfs":{"total":53552873472,"available":53349531648,"internally_reserved":0,"allocated":203341824,"data_stored":203341824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":217328,"kb_used_data":217328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52080400,"statfs":{"total":53552873472,"available":53330329600,"internally_reserved":0,"allocated":222543872,"data_stored":222543872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705844,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":199292,"kb_used_data":199292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52098436,"statfs":{"total":53552873472,"available":53348798464,"internally_reserved":0,"allocated":204075008,"data_stored":204075008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53353545728,"internally_reserved":0,"allocated":199327744,"data_stored":199327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53336465408,"internally_reserved":0,"allocated":216408064,"data_stored":216408064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53355520000,"internally_reserved":0,"allocated":197353472,"data_stored":197353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53301497856,"internally_reserved":0,"allocated":251375616,"data_stored":251375616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:10.716 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-16T16:50:10.719 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:50:10.719 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:50:10.784 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-16T16:50:10.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:50:10.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_37266 2024-09-16T16:50:10.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:50:10.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:50:11.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:11.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:11.311+0000 7f8654f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:11.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:11.319+0000 7f8654f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:11.784 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 120 104 6.49958 6.5 0.162535 0.131654 2024-09-16T16:50:12.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 223 207 6.46816 6.4375 0.0691588 0.139148 2024-09-16T16:50:13.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:13.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:13.695+0000 7f9c9e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:13.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:13.704+0000 7f9c9e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:13.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 326 310 6.45773 6.4375 0.0533294 0.149113 2024-09-16T16:50:14.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 413 397 6.20255 5.4375 0.0953565 0.155878 2024-09-16T16:50:15.617 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:15.617 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:15.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:15.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:15.770+0000 7fdd3a674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:15.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:15.781+0000 7fdd3a674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:15.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 514 498 6.22443 6.3125 0.08126 0.157013 2024-09-16T16:50:15.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:16.153 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:16.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:16.174+0000 7fcadfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:16.179 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-16T16:50:15.799981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21955123,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":407,"num_write_kb":21972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":105120,"kb_used_data":105120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209085792,"statfs":{"total":214211493888,"available":214103851008,"internally_reserved":0,"allocated":107642880,"data_stored":107642880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.103218"},"pg_stats":[{"pgid":"4.f","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.667843+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:13.667843+0000","last_peered":"2024-09-16T16:50:13.667843+0000","last_clean":"2024-09-16T16:50:13.667843+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:13.667843+0000","last_undegraded":"2024-09-16T16:50:13.667843+0000","last_fullsized":"2024-09-16T16:50:13.667843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.739489+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:13.739489+0000","last_peered":"2024-09-16T16:50:13.739489+0000","last_clean":"2024-09-16T16:50:13.739489+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:13.739489+0000","last_undegraded":"2024-09-16T16:50:13.739489+0000","last_fullsized":"2024-09-16T16:50:13.739489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'20","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.422100+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:13.422100+0000","last_peered":"2024-09-16T16:50:13.422100+0000","last_clean":"2024-09-16T16:50:13.422100+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:13.422100+0000","last_undegraded":"2024-09-16T16:50:13.422100+0000","last_fullsized":"2024-09-16T16:50:13.422100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.718446+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:13.718446+0000","last_peered":"2024-09-16T16:50:13.718446+0000","last_clean":"2024-09-16T16:50:13.718446+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:13.718446+0000","last_undegraded":"2024-09-16T16:50:13.718446+0000","last_fullsized":"2024-09-16T16:50:13.718446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.344028+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:13.344028+0000","last_peered":"2024-09-16T16:50:13.344028+0000","last_clean":"2024-09-16T16:50:13.344028+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:13.344028+0000","last_undegraded":"2024-09-16T16:50:13.344028+0000","last_fullsized":"2024-09-16T16:50:13.344028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'13","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.184013+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:13.184013+0000","last_peered":"2024-09-16T16:50:13.184013+0000","last_clean":"2024-09-16T16:50:13.184013+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:13.184013+0000","last_undegraded":"2024-09-16T16:50:13.184013+0000","last_fullsized":"2024-09-16T16:50:13.184013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.710377+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:13.710377+0000","last_peered":"2024-09-16T16:50:13.710377+0000","last_clean":"2024-09-16T16:50:13.710377+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:13.710377+0000","last_undegraded":"2024-09-16T16:50:13.710377+0000","last_fullsized":"2024-09-16T16:50:13.710377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.033321+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:13.033321+0000","last_peered":"2024-09-16T16:50:13.033321+0000","last_clean":"2024-09-16T16:50:13.033321+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:13.033321+0000","last_undegraded":"2024-09-16T16:50:13.033321+0000","last_fullsized":"2024-09-16T16:50:13.033321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.508217+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:13.508217+0000","last_peered":"2024-09-16T16:50:13.508217+0000","last_clean":"2024-09-16T16:50:13.508217+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:13.508217+0000","last_undegraded":"2024-09-16T16:50:13.508217+0000","last_fullsized":"2024-09-16T16:50:13.508217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'26","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.564275+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:13.564275+0000","last_peered":"2024-09-16T16:50:13.564275+0000","last_clean":"2024-09-16T16:50:13.564275+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:13.564275+0000","last_undegraded":"2024-09-16T16:50:13.564275+0000","last_fullsized":"2024-09-16T16:50:13.564275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.691181+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:13.691181+0000","last_peered":"2024-09-16T16:50:13.691181+0000","last_clean":"2024-09-16T16:50:13.691181+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:13.691181+0000","last_undegraded":"2024-09-16T16:50:13.691181+0000","last_fullsized":"2024-09-16T16:50:13.691181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.596227+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:13.596227+0000","last_peered":"2024-09-16T16:50:13.596227+0000","last_clean":"2024-09-16T16:50:13.596227+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:13.596227+0000","last_undegraded":"2024-09-16T16:50:13.596227+0000","last_fullsized":"2024-09-16T16:50:13.596227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'25","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.675374+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:13.675374+0000","last_peered":"2024-09-16T16:50:13.675374+0000","last_clean":"2024-09-16T16:50:13.675374+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:13.675374+0000","last_undegraded":"2024-09-16T16:50:13.675374+0000","last_fullsized":"2024-09-16T16:50:13.675374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.090306+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:13.090306+0000","last_peered":"2024-09-16T16:50:13.090306+0000","last_clean":"2024-09-16T16:50:13.090306+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:13.090306+0000","last_undegraded":"2024-09-16T16:50:13.090306+0000","last_fullsized":"2024-09-16T16:50:13.090306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.479780+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:13.479780+0000","last_peered":"2024-09-16T16:50:13.479780+0000","last_clean":"2024-09-16T16:50:13.479780+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:13.479780+0000","last_undegraded":"2024-09-16T16:50:13.479780+0000","last_fullsized":"2024-09-16T16:50:13.479780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.472312+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:13.472312+0000","last_peered":"2024-09-16T16:50:13.472312+0000","last_clean":"2024-09-16T16:50:13.472312+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:13.472312+0000","last_undegraded":"2024-09-16T16:50:13.472312+0000","last_fullsized":"2024-09-16T16:50:13.472312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073102336,"internally_reserved":0,"allocated":138391552,"data_stored":138391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073233408,"internally_reserved":0,"allocated":138260480,"data_stored":138260480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":27976,"kb_used_data":27976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52269752,"statfs":{"total":53552873472,"available":53524226048,"internally_reserved":0,"allocated":28647424,"data_stored":28647424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24808,"kb_used_data":24808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272920,"statfs":{"total":53552873472,"available":53527470080,"internally_reserved":0,"allocated":25403392,"data_stored":25403392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":26700,"kb_used_data":26700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52271028,"statfs":{"total":53552873472,"available":53525532672,"internally_reserved":0,"allocated":27340800,"data_stored":27340800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":25636,"kb_used_data":25636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272092,"statfs":{"total":53552873472,"available":53526622208,"internally_reserved":0,"allocated":26251264,"data_stored":26251264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53514457088,"internally_reserved":0,"allocated":38416384,"data_stored":38416384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:16.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:16.184+0000 7fcadfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:16.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 15 624 609 6.34317 6.9375 0.0910285 0.156185 2024-09-16T16:50:17.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 735 719 6.41906 6.875 0.120186 0.153811 2024-09-16T16:50:18.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:18.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 850 834 6.51503 7.1875 0.087761 0.151493 2024-09-16T16:50:18.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:18.864+0000 7f6c44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:18.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:18.874+0000 7f6c44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:19.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 959 943 6.54801 6.8125 0.0933646 0.151355 2024-09-16T16:50:20.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 1061 1045 6.53065 6.375 0.32108 0.151411 2024-09-16T16:50:21.181 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:21.181 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:21.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:21.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:21.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:21.330+0000 7f10d96fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:21.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:21.346+0000 7f10d3fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:21.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:21.423+0000 7fb9c5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:21.435+0000 7fb9c5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:21.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:21.694 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-16T16:50:19.800841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21955123,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":407,"num_write_kb":21972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":105120,"kb_used_data":105120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209085792,"statfs":{"total":214211493888,"available":214103851008,"internally_reserved":0,"allocated":107642880,"data_stored":107642880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002132"},"pg_stats":[{"pgid":"4.f","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.667843+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:13.667843+0000","last_peered":"2024-09-16T16:50:13.667843+0000","last_clean":"2024-09-16T16:50:13.667843+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:13.667843+0000","last_undegraded":"2024-09-16T16:50:13.667843+0000","last_fullsized":"2024-09-16T16:50:13.667843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.739489+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:13.739489+0000","last_peered":"2024-09-16T16:50:13.739489+0000","last_clean":"2024-09-16T16:50:13.739489+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:13.739489+0000","last_undegraded":"2024-09-16T16:50:13.739489+0000","last_fullsized":"2024-09-16T16:50:13.739489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'20","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.422100+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:13.422100+0000","last_peered":"2024-09-16T16:50:13.422100+0000","last_clean":"2024-09-16T16:50:13.422100+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:13.422100+0000","last_undegraded":"2024-09-16T16:50:13.422100+0000","last_fullsized":"2024-09-16T16:50:13.422100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.718446+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:13.718446+0000","last_peered":"2024-09-16T16:50:13.718446+0000","last_clean":"2024-09-16T16:50:13.718446+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:13.718446+0000","last_undegraded":"2024-09-16T16:50:13.718446+0000","last_fullsized":"2024-09-16T16:50:13.718446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.344028+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:13.344028+0000","last_peered":"2024-09-16T16:50:13.344028+0000","last_clean":"2024-09-16T16:50:13.344028+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:13.344028+0000","last_undegraded":"2024-09-16T16:50:13.344028+0000","last_fullsized":"2024-09-16T16:50:13.344028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'13","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.184013+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:13.184013+0000","last_peered":"2024-09-16T16:50:13.184013+0000","last_clean":"2024-09-16T16:50:13.184013+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:13.184013+0000","last_undegraded":"2024-09-16T16:50:13.184013+0000","last_fullsized":"2024-09-16T16:50:13.184013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.710377+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:13.710377+0000","last_peered":"2024-09-16T16:50:13.710377+0000","last_clean":"2024-09-16T16:50:13.710377+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:13.710377+0000","last_undegraded":"2024-09-16T16:50:13.710377+0000","last_fullsized":"2024-09-16T16:50:13.710377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.033321+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:13.033321+0000","last_peered":"2024-09-16T16:50:13.033321+0000","last_clean":"2024-09-16T16:50:13.033321+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:13.033321+0000","last_undegraded":"2024-09-16T16:50:13.033321+0000","last_fullsized":"2024-09-16T16:50:13.033321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.508217+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:13.508217+0000","last_peered":"2024-09-16T16:50:13.508217+0000","last_clean":"2024-09-16T16:50:13.508217+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:13.508217+0000","last_undegraded":"2024-09-16T16:50:13.508217+0000","last_fullsized":"2024-09-16T16:50:13.508217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'26","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.564275+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:13.564275+0000","last_peered":"2024-09-16T16:50:13.564275+0000","last_clean":"2024-09-16T16:50:13.564275+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:13.564275+0000","last_undegraded":"2024-09-16T16:50:13.564275+0000","last_fullsized":"2024-09-16T16:50:13.564275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.691181+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:13.691181+0000","last_peered":"2024-09-16T16:50:13.691181+0000","last_clean":"2024-09-16T16:50:13.691181+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:13.691181+0000","last_undegraded":"2024-09-16T16:50:13.691181+0000","last_fullsized":"2024-09-16T16:50:13.691181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.596227+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:13.596227+0000","last_peered":"2024-09-16T16:50:13.596227+0000","last_clean":"2024-09-16T16:50:13.596227+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:13.596227+0000","last_undegraded":"2024-09-16T16:50:13.596227+0000","last_fullsized":"2024-09-16T16:50:13.596227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'25","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.675374+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:13.675374+0000","last_peered":"2024-09-16T16:50:13.675374+0000","last_clean":"2024-09-16T16:50:13.675374+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:13.675374+0000","last_undegraded":"2024-09-16T16:50:13.675374+0000","last_fullsized":"2024-09-16T16:50:13.675374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.090306+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:13.090306+0000","last_peered":"2024-09-16T16:50:13.090306+0000","last_clean":"2024-09-16T16:50:13.090306+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:13.090306+0000","last_undegraded":"2024-09-16T16:50:13.090306+0000","last_fullsized":"2024-09-16T16:50:13.090306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.479780+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:13.479780+0000","last_peered":"2024-09-16T16:50:13.479780+0000","last_clean":"2024-09-16T16:50:13.479780+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:13.479780+0000","last_undegraded":"2024-09-16T16:50:13.479780+0000","last_fullsized":"2024-09-16T16:50:13.479780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.472312+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:13.472312+0000","last_peered":"2024-09-16T16:50:13.472312+0000","last_clean":"2024-09-16T16:50:13.472312+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:13.472312+0000","last_undegraded":"2024-09-16T16:50:13.472312+0000","last_fullsized":"2024-09-16T16:50:13.472312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073102336,"internally_reserved":0,"allocated":138391552,"data_stored":138391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073233408,"internally_reserved":0,"allocated":138260480,"data_stored":138260480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":27976,"kb_used_data":27976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52269752,"statfs":{"total":53552873472,"available":53524226048,"internally_reserved":0,"allocated":28647424,"data_stored":28647424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24808,"kb_used_data":24808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272920,"statfs":{"total":53552873472,"available":53527470080,"internally_reserved":0,"allocated":25403392,"data_stored":25403392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":26700,"kb_used_data":26700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52271028,"statfs":{"total":53552873472,"available":53525532672,"internally_reserved":0,"allocated":27340800,"data_stored":27340800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":25636,"kb_used_data":25636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272092,"statfs":{"total":53552873472,"available":53526622208,"internally_reserved":0,"allocated":26251264,"data_stored":26251264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53514457088,"internally_reserved":0,"allocated":38416384,"data_stored":38416384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:21.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 1160 1144 6.49941 6.1875 0.105888 0.152649 2024-09-16T16:50:22.785 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1261 1245 6.48378 6.3125 0.161988 0.153002 2024-09-16T16:50:23.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1373 1357 6.52344 7 0.0861417 0.152083 2024-09-16T16:50:23.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:24.116+0000 7f9af7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:24.123+0000 7f9af7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:24.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1491 1475 6.58421 7.375 0.043019 0.151089 2024-09-16T16:50:25.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1608 1592 6.63272 7.3125 0.291058 0.149959 2024-09-16T16:50:26.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:26.696 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:26.696 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:26.697 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:26.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:26.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1716 1700 6.64001 6.75 0.093108 0.149497 2024-09-16T16:50:26.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:26.802+0000 7fdbfde63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:26.813+0000 7fdbfde63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:26.862+0000 7f4d62f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:26.879+0000 7f4d62f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.989 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:26.990 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:26.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:26.995 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:26.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:27.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.172+0000 7fc57b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.187+0000 7fc57b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:27.313 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:27.314 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:27.314 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:27.314 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:27.314 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:27.314 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:27.317 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:27.317 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:27.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:27.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.456+0000 7f7025b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.471+0000 7f7025b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:27.525 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:27.529 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:27.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:27.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:27.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.676+0000 7f19c14a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:27.688+0000 7f19c14a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1831 1815 6.67217 7.1875 0.122541 0.149259 2024-09-16T16:50:27.817 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:27.817 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:27.817 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:27.818 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:27.821 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:27.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:28.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1931 1915 6.64868 6.25 0.190784 0.149618 2024-09-16T16:50:29.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:29.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:29.510+0000 7feaa9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:29.517+0000 7feaa9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:29.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 2036 2020 6.64412 6.5625 0.357625 0.149758 2024-09-16T16:50:30.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:50:30.787059+0000 min lat: 0.0241636 max lat: 0.775385 avg lat: 0.148947 2024-09-16T16:50:30.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:50:30.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 2153 2137 6.6775 7.3125 0.0879182 0.148947 2024-09-16T16:50:31.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 2260 2244 6.67794 6.6875 0.0780773 0.149226 2024-09-16T16:50:31.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:32.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:32.140+0000 7ff3cc8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:32.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:32.148+0000 7ff3cc8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:32.786 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2372 2356 6.69255 7 0.0922039 0.148731 2024-09-16T16:50:32.823 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:32.823 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:32.823 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:32.996+0000 7f92080d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:33.009+0000 7f92080d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:33.376 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:33.396 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-16T16:50:31.803442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":21955123,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":407,"num_write_kb":21972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":105120,"kb_used_data":105120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209085792,"statfs":{"total":214211493888,"available":214103851008,"internally_reserved":0,"allocated":107642880,"data_stored":107642880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002601"},"pg_stats":[{"pgid":"4.f","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.667843+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:13.667843+0000","last_peered":"2024-09-16T16:50:13.667843+0000","last_clean":"2024-09-16T16:50:13.667843+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:13.667843+0000","last_undegraded":"2024-09-16T16:50:13.667843+0000","last_fullsized":"2024-09-16T16:50:13.667843+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.739489+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:13.739489+0000","last_peered":"2024-09-16T16:50:13.739489+0000","last_clean":"2024-09-16T16:50:13.739489+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:13.739489+0000","last_undegraded":"2024-09-16T16:50:13.739489+0000","last_fullsized":"2024-09-16T16:50:13.739489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'20","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.422100+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:13.422100+0000","last_peered":"2024-09-16T16:50:13.422100+0000","last_clean":"2024-09-16T16:50:13.422100+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:13.422100+0000","last_undegraded":"2024-09-16T16:50:13.422100+0000","last_fullsized":"2024-09-16T16:50:13.422100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.718446+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:13.718446+0000","last_peered":"2024-09-16T16:50:13.718446+0000","last_clean":"2024-09-16T16:50:13.718446+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:13.718446+0000","last_undegraded":"2024-09-16T16:50:13.718446+0000","last_fullsized":"2024-09-16T16:50:13.718446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.344028+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:13.344028+0000","last_peered":"2024-09-16T16:50:13.344028+0000","last_clean":"2024-09-16T16:50:13.344028+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:13.344028+0000","last_undegraded":"2024-09-16T16:50:13.344028+0000","last_fullsized":"2024-09-16T16:50:13.344028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'13","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.184013+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:13.184013+0000","last_peered":"2024-09-16T16:50:13.184013+0000","last_clean":"2024-09-16T16:50:13.184013+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:13.184013+0000","last_undegraded":"2024-09-16T16:50:13.184013+0000","last_fullsized":"2024-09-16T16:50:13.184013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.710377+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:13.710377+0000","last_peered":"2024-09-16T16:50:13.710377+0000","last_clean":"2024-09-16T16:50:13.710377+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:13.710377+0000","last_undegraded":"2024-09-16T16:50:13.710377+0000","last_fullsized":"2024-09-16T16:50:13.710377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'14","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.033321+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:13.033321+0000","last_peered":"2024-09-16T16:50:13.033321+0000","last_clean":"2024-09-16T16:50:13.033321+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:13.033321+0000","last_undegraded":"2024-09-16T16:50:13.033321+0000","last_fullsized":"2024-09-16T16:50:13.033321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.508217+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:13.508217+0000","last_peered":"2024-09-16T16:50:13.508217+0000","last_clean":"2024-09-16T16:50:13.508217+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:13.508217+0000","last_undegraded":"2024-09-16T16:50:13.508217+0000","last_fullsized":"2024-09-16T16:50:13.508217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'26","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.564275+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:13.564275+0000","last_peered":"2024-09-16T16:50:13.564275+0000","last_clean":"2024-09-16T16:50:13.564275+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:13.564275+0000","last_undegraded":"2024-09-16T16:50:13.564275+0000","last_fullsized":"2024-09-16T16:50:13.564275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'16","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.691181+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:13.691181+0000","last_peered":"2024-09-16T16:50:13.691181+0000","last_clean":"2024-09-16T16:50:13.691181+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:13.691181+0000","last_undegraded":"2024-09-16T16:50:13.691181+0000","last_fullsized":"2024-09-16T16:50:13.691181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'28","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.596227+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:13.596227+0000","last_peered":"2024-09-16T16:50:13.596227+0000","last_clean":"2024-09-16T16:50:13.596227+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:13.596227+0000","last_undegraded":"2024-09-16T16:50:13.596227+0000","last_fullsized":"2024-09-16T16:50:13.596227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'25","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.675374+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:13.675374+0000","last_peered":"2024-09-16T16:50:13.675374+0000","last_clean":"2024-09-16T16:50:13.675374+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:13.675374+0000","last_undegraded":"2024-09-16T16:50:13.675374+0000","last_fullsized":"2024-09-16T16:50:13.675374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'21","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.090306+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:13.090306+0000","last_peered":"2024-09-16T16:50:13.090306+0000","last_clean":"2024-09-16T16:50:13.090306+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:13.090306+0000","last_undegraded":"2024-09-16T16:50:13.090306+0000","last_fullsized":"2024-09-16T16:50:13.090306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'23","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.479780+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:13.479780+0000","last_peered":"2024-09-16T16:50:13.479780+0000","last_clean":"2024-09-16T16:50:13.479780+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:13.479780+0000","last_undegraded":"2024-09-16T16:50:13.479780+0000","last_fullsized":"2024-09-16T16:50:13.479780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'19","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:13.472312+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:13.472312+0000","last_peered":"2024-09-16T16:50:13.472312+0000","last_clean":"2024-09-16T16:50:13.472312+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:13.472312+0000","last_undegraded":"2024-09-16T16:50:13.472312+0000","last_fullsized":"2024-09-16T16:50:13.472312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":21364736,"num_objects":326,"num_object_clones":0,"num_object_copies":978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073102336,"internally_reserved":0,"allocated":138391552,"data_stored":138391552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214073233408,"internally_reserved":0,"allocated":138260480,"data_stored":138260480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":27976,"kb_used_data":27976,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52269752,"statfs":{"total":53552873472,"available":53524226048,"internally_reserved":0,"allocated":28647424,"data_stored":28647424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24808,"kb_used_data":24808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272920,"statfs":{"total":53552873472,"available":53527470080,"internally_reserved":0,"allocated":25403392,"data_stored":25403392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":26700,"kb_used_data":26700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52271028,"statfs":{"total":53552873472,"available":53525532672,"internally_reserved":0,"allocated":27340800,"data_stored":27340800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":25636,"kb_used_data":25636,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272092,"statfs":{"total":53552873472,"available":53526622208,"internally_reserved":0,"allocated":26251264,"data_stored":26251264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53514588160,"internally_reserved":0,"allocated":38285312,"data_stored":38285312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53520818176,"internally_reserved":0,"allocated":32055296,"data_stored":32055296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53516935168,"internally_reserved":0,"allocated":35938304,"data_stored":35938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53520891904,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53514457088,"internally_reserved":0,"allocated":38416384,"data_stored":38416384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:33.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2475 2459 6.68143 6.4375 0.162822 0.148929 2024-09-16T16:50:34.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:34.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 2577 2561 6.66864 6.375 0.0567398 0.148962 2024-09-16T16:50:34.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:34.816+0000 7f9f184bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:34.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:34.824+0000 7f9f184bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:35.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 2676 2660 6.64937 6.1875 0.0450744 0.149648 2024-09-16T16:50:36.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2789 2773 6.66524 7.0625 0.369188 0.14923 2024-09-16T16:50:37.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:37.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:37.474+0000 7fc5b426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:37.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:37.481+0000 7fc5b426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:37.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2914 2898 6.7077 7.8125 0.0627094 0.148566 2024-09-16T16:50:38.398 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:38.399 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:38.399 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:38.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:38.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:38.555+0000 7f1ec0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:38.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:38.572+0000 7f1ec0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:38.675 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:38.675 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:38.676 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:38.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:38.680 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:38.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:38.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 3029 3013 6.72481 7.1875 0.0802796 0.148232 2024-09-16T16:50:38.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:38.846+0000 7f082226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:38.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:38.858+0000 7f082226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:39.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:39.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:39.010 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:39.178+0000 7efe0fabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:39.194+0000 7efe0fabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:39.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:39.327 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:39.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:39.499+0000 7fd256951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:39.511+0000 7fd256951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.541 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:39.542 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:39.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:39.545 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:39.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 3152 3136 6.75798 7.6875 0.141933 0.147658 2024-09-16T16:50:39.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:40.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:40.069+0000 7f51f0351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:40.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:40.077+0000 7f51f0351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:40.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 3273 3257 6.78477 7.5625 0.0714833 0.146949 2024-09-16T16:50:41.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3394 3378 6.80984 7.5625 0.119071 0.146445 2024-09-16T16:50:42.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:42.727+0000 7fe41a2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:42.737+0000 7fe41a2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 3516 3500 6.83529 7.625 0.0682062 0.145959 2024-09-16T16:50:43.787 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 3641 3625 6.86488 7.8125 0.0723651 0.145235 2024-09-16T16:50:44.546 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:44.546 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:44.546 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:44.546 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:44.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:44.694+0000 7fa9dd311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:44.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:44.707+0000 7fa9dd311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:44.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 3762 3746 6.88537 7.5625 0.119779 0.144915 2024-09-16T16:50:44.838 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:44.839 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:44.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:44.844 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:44.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:45.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:44.990+0000 7f4d49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.007+0000 7f4d49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:45.137 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:45.138 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:45.142 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:45.143 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:45.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:45.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.303+0000 7f412e488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.316+0000 7f412e488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.380+0000 7f1ac5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.388+0000 7f1ac5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.414 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:45.414 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:45.414 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:45.415 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:45.420 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:45.420 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:45.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:45.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.580+0000 7fb30ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:45.600+0000 7fb30ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:50:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:50:45.745 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:45.745 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:45.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 3875 3859 6.89042 7.0625 0.204216 0.14487 2024-09-16T16:50:46.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 3989 3973 6.89691 7.125 0.092865 0.144609 2024-09-16T16:50:47.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 4116 4100 6.92502 7.9375 0.19535 0.144091 2024-09-16T16:50:47.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:48.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:48.079+0000 7fb011ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:48.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:48.088+0000 7fb011ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:48.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 4219 4203 6.91217 6.4375 0.102873 0.144217 2024-09-16T16:50:49.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 4339 4323 6.92723 7.5 0.0641955 0.144064 2024-09-16T16:50:50.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:50.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:50.650+0000 7f7a79351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:50.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:50.657+0000 7f7a79351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:50.746 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:50.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:50.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:50.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:50:50.788993+0000 min lat: 0.0239766 max lat: 0.775385 avg lat: 0.144251 2024-09-16T16:50:50.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:50:50.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 4441 4425 6.91341 6.375 0.294901 0.144251 2024-09-16T16:50:50.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:50.907+0000 7f8647191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:50.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:50.917+0000 7f8647191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:51.290 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:51.291 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:51.309 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-16T16:50:49.807307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239403571,"num_objects":3648,"num_object_clones":0,"num_object_copies":10944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3725,"num_write_kb":234324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3699,"ondisk_log_size":3699,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1382380,"kb_used_data":1382380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207808532,"statfs":{"total":214211493888,"available":212795936768,"internally_reserved":0,"allocated":1415557120,"data_stored":1415557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":217448448,"num_objects":3318,"num_object_clones":0,"num_object_copies":9954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3318,"num_write_kb":212352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002709"},"pg_stats":[{"pgid":"4.f","version":"35'214","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641681+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:43.641681+0000","last_peered":"2024-09-16T16:50:43.641681+0000","last_clean":"2024-09-16T16:50:43.641681+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:43.641681+0000","last_undegraded":"2024-09-16T16:50:43.641681+0000","last_fullsized":"2024-09-16T16:50:43.641681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'243","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.356213+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:43.356213+0000","last_peered":"2024-09-16T16:50:43.356213+0000","last_clean":"2024-09-16T16:50:43.356213+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:43.356213+0000","last_undegraded":"2024-09-16T16:50:43.356213+0000","last_fullsized":"2024-09-16T16:50:43.356213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'247","reported_seq":259,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.642669+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:43.642669+0000","last_peered":"2024-09-16T16:50:43.642669+0000","last_clean":"2024-09-16T16:50:43.642669+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:43.642669+0000","last_undegraded":"2024-09-16T16:50:43.642669+0000","last_fullsized":"2024-09-16T16:50:43.642669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'226","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641362+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:43.641362+0000","last_peered":"2024-09-16T16:50:43.641362+0000","last_clean":"2024-09-16T16:50:43.641362+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:43.641362+0000","last_undegraded":"2024-09-16T16:50:43.641362+0000","last_fullsized":"2024-09-16T16:50:43.641362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'215","reported_seq":227,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.538025+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:43.538025+0000","last_peered":"2024-09-16T16:50:43.538025+0000","last_clean":"2024-09-16T16:50:43.538025+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:43.538025+0000","last_undegraded":"2024-09-16T16:50:43.538025+0000","last_fullsized":"2024-09-16T16:50:43.538025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.556212+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:43.556212+0000","last_peered":"2024-09-16T16:50:43.556212+0000","last_clean":"2024-09-16T16:50:43.556212+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:43.556212+0000","last_undegraded":"2024-09-16T16:50:43.556212+0000","last_fullsized":"2024-09-16T16:50:43.556212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'229","reported_seq":241,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.613579+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:43.613579+0000","last_peered":"2024-09-16T16:50:43.613579+0000","last_clean":"2024-09-16T16:50:43.613579+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:43.613579+0000","last_undegraded":"2024-09-16T16:50:43.613579+0000","last_fullsized":"2024-09-16T16:50:43.613579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'202","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.598892+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:43.598892+0000","last_peered":"2024-09-16T16:50:43.598892+0000","last_clean":"2024-09-16T16:50:43.598892+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:43.598892+0000","last_undegraded":"2024-09-16T16:50:43.598892+0000","last_fullsized":"2024-09-16T16:50:43.598892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'212","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.691975+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:43.691975+0000","last_peered":"2024-09-16T16:50:43.691975+0000","last_clean":"2024-09-16T16:50:43.691975+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:43.691975+0000","last_undegraded":"2024-09-16T16:50:43.691975+0000","last_fullsized":"2024-09-16T16:50:43.691975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'220","reported_seq":232,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.527429+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:43.527429+0000","last_peered":"2024-09-16T16:50:43.527429+0000","last_clean":"2024-09-16T16:50:43.527429+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:43.527429+0000","last_undegraded":"2024-09-16T16:50:43.527429+0000","last_fullsized":"2024-09-16T16:50:43.527429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'213","reported_seq":225,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.749768+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:43.749768+0000","last_peered":"2024-09-16T16:50:43.749768+0000","last_clean":"2024-09-16T16:50:43.749768+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:43.749768+0000","last_undegraded":"2024-09-16T16:50:43.749768+0000","last_fullsized":"2024-09-16T16:50:43.749768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'257","reported_seq":269,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.810559+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:43.810559+0000","last_peered":"2024-09-16T16:50:43.810559+0000","last_clean":"2024-09-16T16:50:43.810559+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:43.810559+0000","last_undegraded":"2024-09-16T16:50:43.810559+0000","last_fullsized":"2024-09-16T16:50:43.810559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'230","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.501428+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:43.501428+0000","last_peered":"2024-09-16T16:50:43.501428+0000","last_clean":"2024-09-16T16:50:43.501428+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:43.501428+0000","last_undegraded":"2024-09-16T16:50:43.501428+0000","last_fullsized":"2024-09-16T16:50:43.501428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'235","reported_seq":247,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.653151+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:43.653151+0000","last_peered":"2024-09-16T16:50:43.653151+0000","last_clean":"2024-09-16T16:50:43.653151+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:43.653151+0000","last_undegraded":"2024-09-16T16:50:43.653151+0000","last_fullsized":"2024-09-16T16:50:43.653151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.360957+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:43.360957+0000","last_peered":"2024-09-16T16:50:43.360957+0000","last_clean":"2024-09-16T16:50:43.360957+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:43.360957+0000","last_undegraded":"2024-09-16T16:50:43.360957+0000","last_fullsized":"2024-09-16T16:50:43.360957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'237","reported_seq":249,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.485205+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:43.485205+0000","last_peered":"2024-09-16T16:50:43.485205+0000","last_clean":"2024-09-16T16:50:43.485205+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:43.485205+0000","last_undegraded":"2024-09-16T16:50:43.485205+0000","last_fullsized":"2024-09-16T16:50:43.485205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":238813184,"num_objects":3644,"num_object_clones":0,"num_object_copies":10932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3644,"num_write_kb":233216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760002560,"internally_reserved":0,"allocated":1451491328,"data_stored":1451491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3644,"ondisk_log_size":3644,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760264704,"internally_reserved":0,"allocated":1451229184,"data_stored":1451229184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":372364,"kb_used_data":372364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51925364,"statfs":{"total":53552873472,"available":53171572736,"internally_reserved":0,"allocated":381300736,"data_stored":381300736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":291848,"kb_used_data":291848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52005880,"statfs":{"total":53552873472,"available":53254021120,"internally_reserved":0,"allocated":298852352,"data_stored":298852352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":376328,"kb_used_data":376328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51921400,"statfs":{"total":53552873472,"available":53167513600,"internally_reserved":0,"allocated":385359872,"data_stored":385359872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":341840,"kb_used_data":341840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51955888,"statfs":{"total":53552873472,"available":53202829312,"internally_reserved":0,"allocated":350044160,"data_stored":350044160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53156925440,"internally_reserved":0,"allocated":395948032,"data_stored":395948032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53160910848,"internally_reserved":0,"allocated":391962624,"data_stored":391962624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53156794368,"internally_reserved":0,"allocated":396079104,"data_stored":396079104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53160779776,"internally_reserved":0,"allocated":392093696,"data_stored":392093696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:51.788 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 4532 4516 6.88349 5.6875 0.0461125 0.144886 2024-09-16T16:50:52.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 4641 4625 6.88178 6.8125 0.117057 0.144862 2024-09-16T16:50:53.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:53.177+0000 7f4bb9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:53.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:53.185+0000 7f4bb9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:53.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 4748 4732 6.87725 6.6875 0.0878541 0.145147 2024-09-16T16:50:54.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 4858 4842 6.87719 6.875 0.0681794 0.145044 2024-09-16T16:50:55.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 4965 4949 6.87296 6.6875 0.0541282 0.145101 2024-09-16T16:50:55.846 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:56.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:55.999+0000 7fbc35791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:56.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:56.008+0000 7fbc35791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:56.310 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:56.310 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:56.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:56.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:56.466+0000 7ff166791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:56.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:56.480+0000 7ff166791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:50:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:50:56.761 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-16T16:50:55.808555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239403571,"num_objects":3648,"num_object_clones":0,"num_object_copies":10944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3725,"num_write_kb":234324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3699,"ondisk_log_size":3699,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1382380,"kb_used_data":1382380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207808532,"statfs":{"total":214211493888,"available":212795936768,"internally_reserved":0,"allocated":1415557120,"data_stored":1415557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67960832,"num_objects":1037,"num_object_clones":0,"num_object_copies":3111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"4.f","version":"35'214","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641681+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:43.641681+0000","last_peered":"2024-09-16T16:50:43.641681+0000","last_clean":"2024-09-16T16:50:43.641681+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:43.641681+0000","last_undegraded":"2024-09-16T16:50:43.641681+0000","last_fullsized":"2024-09-16T16:50:43.641681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'243","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.356213+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:43.356213+0000","last_peered":"2024-09-16T16:50:43.356213+0000","last_clean":"2024-09-16T16:50:43.356213+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:43.356213+0000","last_undegraded":"2024-09-16T16:50:43.356213+0000","last_fullsized":"2024-09-16T16:50:43.356213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'247","reported_seq":259,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.642669+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:43.642669+0000","last_peered":"2024-09-16T16:50:43.642669+0000","last_clean":"2024-09-16T16:50:43.642669+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:43.642669+0000","last_undegraded":"2024-09-16T16:50:43.642669+0000","last_fullsized":"2024-09-16T16:50:43.642669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'226","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641362+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:43.641362+0000","last_peered":"2024-09-16T16:50:43.641362+0000","last_clean":"2024-09-16T16:50:43.641362+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:43.641362+0000","last_undegraded":"2024-09-16T16:50:43.641362+0000","last_fullsized":"2024-09-16T16:50:43.641362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'215","reported_seq":227,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.538025+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:43.538025+0000","last_peered":"2024-09-16T16:50:43.538025+0000","last_clean":"2024-09-16T16:50:43.538025+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:43.538025+0000","last_undegraded":"2024-09-16T16:50:43.538025+0000","last_fullsized":"2024-09-16T16:50:43.538025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.556212+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:43.556212+0000","last_peered":"2024-09-16T16:50:43.556212+0000","last_clean":"2024-09-16T16:50:43.556212+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:43.556212+0000","last_undegraded":"2024-09-16T16:50:43.556212+0000","last_fullsized":"2024-09-16T16:50:43.556212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'229","reported_seq":241,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.613579+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:43.613579+0000","last_peered":"2024-09-16T16:50:43.613579+0000","last_clean":"2024-09-16T16:50:43.613579+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:43.613579+0000","last_undegraded":"2024-09-16T16:50:43.613579+0000","last_fullsized":"2024-09-16T16:50:43.613579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'202","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.598892+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:43.598892+0000","last_peered":"2024-09-16T16:50:43.598892+0000","last_clean":"2024-09-16T16:50:43.598892+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:43.598892+0000","last_undegraded":"2024-09-16T16:50:43.598892+0000","last_fullsized":"2024-09-16T16:50:43.598892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'212","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.691975+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:43.691975+0000","last_peered":"2024-09-16T16:50:43.691975+0000","last_clean":"2024-09-16T16:50:43.691975+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:43.691975+0000","last_undegraded":"2024-09-16T16:50:43.691975+0000","last_fullsized":"2024-09-16T16:50:43.691975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'220","reported_seq":232,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.527429+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:43.527429+0000","last_peered":"2024-09-16T16:50:43.527429+0000","last_clean":"2024-09-16T16:50:43.527429+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:43.527429+0000","last_undegraded":"2024-09-16T16:50:43.527429+0000","last_fullsized":"2024-09-16T16:50:43.527429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'213","reported_seq":225,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.749768+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:43.749768+0000","last_peered":"2024-09-16T16:50:43.749768+0000","last_clean":"2024-09-16T16:50:43.749768+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:43.749768+0000","last_undegraded":"2024-09-16T16:50:43.749768+0000","last_fullsized":"2024-09-16T16:50:43.749768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'257","reported_seq":269,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.810559+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:43.810559+0000","last_peered":"2024-09-16T16:50:43.810559+0000","last_clean":"2024-09-16T16:50:43.810559+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:43.810559+0000","last_undegraded":"2024-09-16T16:50:43.810559+0000","last_fullsized":"2024-09-16T16:50:43.810559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'230","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.501428+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:43.501428+0000","last_peered":"2024-09-16T16:50:43.501428+0000","last_clean":"2024-09-16T16:50:43.501428+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:43.501428+0000","last_undegraded":"2024-09-16T16:50:43.501428+0000","last_fullsized":"2024-09-16T16:50:43.501428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'235","reported_seq":247,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.653151+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:43.653151+0000","last_peered":"2024-09-16T16:50:43.653151+0000","last_clean":"2024-09-16T16:50:43.653151+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:43.653151+0000","last_undegraded":"2024-09-16T16:50:43.653151+0000","last_fullsized":"2024-09-16T16:50:43.653151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.360957+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:43.360957+0000","last_peered":"2024-09-16T16:50:43.360957+0000","last_clean":"2024-09-16T16:50:43.360957+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:43.360957+0000","last_undegraded":"2024-09-16T16:50:43.360957+0000","last_fullsized":"2024-09-16T16:50:43.360957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'237","reported_seq":249,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.485205+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:43.485205+0000","last_peered":"2024-09-16T16:50:43.485205+0000","last_clean":"2024-09-16T16:50:43.485205+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:43.485205+0000","last_undegraded":"2024-09-16T16:50:43.485205+0000","last_fullsized":"2024-09-16T16:50:43.485205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":238813184,"num_objects":3644,"num_object_clones":0,"num_object_copies":10932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3644,"num_write_kb":233216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760002560,"internally_reserved":0,"allocated":1451491328,"data_stored":1451491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3644,"ondisk_log_size":3644,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760264704,"internally_reserved":0,"allocated":1451229184,"data_stored":1451229184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":372364,"kb_used_data":372364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51925364,"statfs":{"total":53552873472,"available":53171572736,"internally_reserved":0,"allocated":381300736,"data_stored":381300736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":291848,"kb_used_data":291848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52005880,"statfs":{"total":53552873472,"available":53254021120,"internally_reserved":0,"allocated":298852352,"data_stored":298852352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":376328,"kb_used_data":376328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51921400,"statfs":{"total":53552873472,"available":53167513600,"internally_reserved":0,"allocated":385359872,"data_stored":385359872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":341840,"kb_used_data":341840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51955888,"statfs":{"total":53552873472,"available":53202829312,"internally_reserved":0,"allocated":350044160,"data_stored":350044160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53156925440,"internally_reserved":0,"allocated":395948032,"data_stored":395948032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53160910848,"internally_reserved":0,"allocated":391962624,"data_stored":391962624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53156794368,"internally_reserved":0,"allocated":396079104,"data_stored":396079104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53160779776,"internally_reserved":0,"allocated":392093696,"data_stored":392093696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:56.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 5064 5048 6.85804 6.1875 0.26531 0.145457 2024-09-16T16:50:57.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 5178 5162 6.86371 7.125 0.175014 0.145484 2024-09-16T16:50:58.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:58.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:58.628+0000 7f7d38791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:58.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:50:58.637+0000 7f7d38791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:58.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 5291 5275 6.86784 7.0625 0.270417 0.145405 2024-09-16T16:50:59.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 5406 5390 6.87435 7.1875 0.177936 0.145259 2024-09-16T16:51:00.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 5517 5501 6.8756 6.9375 0.0537595 0.145056 2024-09-16T16:51:01.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:01.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:01.412+0000 7f4247991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:01.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:01.423+0000 7f4247991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:01.763 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:01.764 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:01.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:01.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 5626 5610 6.87435 6.8125 0.0667471 0.145213 2024-09-16T16:51:01.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:01.937+0000 7f8eec8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:01.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:01.952+0000 7f8eec8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:02.261 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:02.284 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-16T16:51:01.809902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239403571,"num_objects":3648,"num_object_clones":0,"num_object_copies":10944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3725,"num_write_kb":234324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3699,"ondisk_log_size":3699,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1382380,"kb_used_data":1382380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207808532,"statfs":{"total":214211493888,"available":212795936768,"internally_reserved":0,"allocated":1415557120,"data_stored":1415557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002594"},"pg_stats":[{"pgid":"4.f","version":"35'214","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641681+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:43.641681+0000","last_peered":"2024-09-16T16:50:43.641681+0000","last_clean":"2024-09-16T16:50:43.641681+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:43.641681+0000","last_undegraded":"2024-09-16T16:50:43.641681+0000","last_fullsized":"2024-09-16T16:50:43.641681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'243","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.356213+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:43.356213+0000","last_peered":"2024-09-16T16:50:43.356213+0000","last_clean":"2024-09-16T16:50:43.356213+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:43.356213+0000","last_undegraded":"2024-09-16T16:50:43.356213+0000","last_fullsized":"2024-09-16T16:50:43.356213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'247","reported_seq":259,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.642669+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:43.642669+0000","last_peered":"2024-09-16T16:50:43.642669+0000","last_clean":"2024-09-16T16:50:43.642669+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:43.642669+0000","last_undegraded":"2024-09-16T16:50:43.642669+0000","last_fullsized":"2024-09-16T16:50:43.642669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'226","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641362+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:43.641362+0000","last_peered":"2024-09-16T16:50:43.641362+0000","last_clean":"2024-09-16T16:50:43.641362+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:43.641362+0000","last_undegraded":"2024-09-16T16:50:43.641362+0000","last_fullsized":"2024-09-16T16:50:43.641362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'215","reported_seq":227,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.538025+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:43.538025+0000","last_peered":"2024-09-16T16:50:43.538025+0000","last_clean":"2024-09-16T16:50:43.538025+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:43.538025+0000","last_undegraded":"2024-09-16T16:50:43.538025+0000","last_fullsized":"2024-09-16T16:50:43.538025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.556212+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:43.556212+0000","last_peered":"2024-09-16T16:50:43.556212+0000","last_clean":"2024-09-16T16:50:43.556212+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:43.556212+0000","last_undegraded":"2024-09-16T16:50:43.556212+0000","last_fullsized":"2024-09-16T16:50:43.556212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'229","reported_seq":241,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.613579+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:43.613579+0000","last_peered":"2024-09-16T16:50:43.613579+0000","last_clean":"2024-09-16T16:50:43.613579+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:43.613579+0000","last_undegraded":"2024-09-16T16:50:43.613579+0000","last_fullsized":"2024-09-16T16:50:43.613579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'202","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.598892+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:43.598892+0000","last_peered":"2024-09-16T16:50:43.598892+0000","last_clean":"2024-09-16T16:50:43.598892+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:43.598892+0000","last_undegraded":"2024-09-16T16:50:43.598892+0000","last_fullsized":"2024-09-16T16:50:43.598892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'212","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.691975+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:43.691975+0000","last_peered":"2024-09-16T16:50:43.691975+0000","last_clean":"2024-09-16T16:50:43.691975+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:43.691975+0000","last_undegraded":"2024-09-16T16:50:43.691975+0000","last_fullsized":"2024-09-16T16:50:43.691975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'220","reported_seq":232,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.527429+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:43.527429+0000","last_peered":"2024-09-16T16:50:43.527429+0000","last_clean":"2024-09-16T16:50:43.527429+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:43.527429+0000","last_undegraded":"2024-09-16T16:50:43.527429+0000","last_fullsized":"2024-09-16T16:50:43.527429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'213","reported_seq":225,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.749768+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:43.749768+0000","last_peered":"2024-09-16T16:50:43.749768+0000","last_clean":"2024-09-16T16:50:43.749768+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:43.749768+0000","last_undegraded":"2024-09-16T16:50:43.749768+0000","last_fullsized":"2024-09-16T16:50:43.749768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'257","reported_seq":269,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.810559+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:43.810559+0000","last_peered":"2024-09-16T16:50:43.810559+0000","last_clean":"2024-09-16T16:50:43.810559+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:43.810559+0000","last_undegraded":"2024-09-16T16:50:43.810559+0000","last_fullsized":"2024-09-16T16:50:43.810559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'230","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.501428+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:43.501428+0000","last_peered":"2024-09-16T16:50:43.501428+0000","last_clean":"2024-09-16T16:50:43.501428+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:43.501428+0000","last_undegraded":"2024-09-16T16:50:43.501428+0000","last_fullsized":"2024-09-16T16:50:43.501428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'235","reported_seq":247,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.653151+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:43.653151+0000","last_peered":"2024-09-16T16:50:43.653151+0000","last_clean":"2024-09-16T16:50:43.653151+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:43.653151+0000","last_undegraded":"2024-09-16T16:50:43.653151+0000","last_fullsized":"2024-09-16T16:50:43.653151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.360957+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:43.360957+0000","last_peered":"2024-09-16T16:50:43.360957+0000","last_clean":"2024-09-16T16:50:43.360957+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:43.360957+0000","last_undegraded":"2024-09-16T16:50:43.360957+0000","last_fullsized":"2024-09-16T16:50:43.360957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'237","reported_seq":249,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.485205+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:43.485205+0000","last_peered":"2024-09-16T16:50:43.485205+0000","last_clean":"2024-09-16T16:50:43.485205+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:43.485205+0000","last_undegraded":"2024-09-16T16:50:43.485205+0000","last_fullsized":"2024-09-16T16:50:43.485205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":238813184,"num_objects":3644,"num_object_clones":0,"num_object_copies":10932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3644,"num_write_kb":233216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760002560,"internally_reserved":0,"allocated":1451491328,"data_stored":1451491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3644,"ondisk_log_size":3644,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760264704,"internally_reserved":0,"allocated":1451229184,"data_stored":1451229184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":372364,"kb_used_data":372364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51925364,"statfs":{"total":53552873472,"available":53171572736,"internally_reserved":0,"allocated":381300736,"data_stored":381300736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":291848,"kb_used_data":291848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52005880,"statfs":{"total":53552873472,"available":53254021120,"internally_reserved":0,"allocated":298852352,"data_stored":298852352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":376328,"kb_used_data":376328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51921400,"statfs":{"total":53552873472,"available":53167513600,"internally_reserved":0,"allocated":385359872,"data_stored":385359872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":341840,"kb_used_data":341840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51955888,"statfs":{"total":53552873472,"available":53202829312,"internally_reserved":0,"allocated":350044160,"data_stored":350044160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53156925440,"internally_reserved":0,"allocated":395948032,"data_stored":395948032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53160910848,"internally_reserved":0,"allocated":391962624,"data_stored":391962624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53156794368,"internally_reserved":0,"allocated":396079104,"data_stored":396079104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53160779776,"internally_reserved":0,"allocated":392093696,"data_stored":392093696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:02.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 5733 5717 6.87074 6.6875 0.0959406 0.145245 2024-09-16T16:51:03.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 5845 5829 6.87316 7 0.0915204 0.145266 2024-09-16T16:51:04.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:04.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:04.240+0000 7f1e3a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:04.251+0000 7f1e3a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:04.789 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 5957 5941 6.8755 7 0.121248 0.145169 2024-09-16T16:51:05.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 6068 6052 6.87662 6.9375 0.177345 0.145213 2024-09-16T16:51:06.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:06.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 6169 6153 6.86653 6.3125 0.212162 0.145388 2024-09-16T16:51:06.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:06.944+0000 7f80e5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:06.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:06.953+0000 7f80e5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:07.287 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:07.287 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:07.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:07.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:07.465+0000 7ff14de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:07.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:07.480+0000 7ff14de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:07.768 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:07.768 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:07.786 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-16T16:51:05.810823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239403571,"num_objects":3648,"num_object_clones":0,"num_object_copies":10944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3725,"num_write_kb":234324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3699,"ondisk_log_size":3699,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1382380,"kb_used_data":1382380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207808532,"statfs":{"total":214211493888,"available":212795936768,"internally_reserved":0,"allocated":1415557120,"data_stored":1415557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002720"},"pg_stats":[{"pgid":"4.f","version":"35'214","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641681+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:50:43.641681+0000","last_peered":"2024-09-16T16:50:43.641681+0000","last_clean":"2024-09-16T16:50:43.641681+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:50:43.641681+0000","last_undegraded":"2024-09-16T16:50:43.641681+0000","last_fullsized":"2024-09-16T16:50:43.641681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":13696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"35'243","reported_seq":255,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.356213+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:50:43.356213+0000","last_peered":"2024-09-16T16:50:43.356213+0000","last_clean":"2024-09-16T16:50:43.356213+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:50:43.356213+0000","last_undegraded":"2024-09-16T16:50:43.356213+0000","last_fullsized":"2024-09-16T16:50:43.356213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":15552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'247","reported_seq":259,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.642669+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:50:43.642669+0000","last_peered":"2024-09-16T16:50:43.642669+0000","last_clean":"2024-09-16T16:50:43.642669+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:50:43.642669+0000","last_undegraded":"2024-09-16T16:50:43.642669+0000","last_fullsized":"2024-09-16T16:50:43.642669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'226","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.641362+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:50:43.641362+0000","last_peered":"2024-09-16T16:50:43.641362+0000","last_clean":"2024-09-16T16:50:43.641362+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:50:43.641362+0000","last_undegraded":"2024-09-16T16:50:43.641362+0000","last_fullsized":"2024-09-16T16:50:43.641362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":14464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'215","reported_seq":227,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.538025+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:50:43.538025+0000","last_peered":"2024-09-16T16:50:43.538025+0000","last_clean":"2024-09-16T16:50:43.538025+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:50:43.538025+0000","last_undegraded":"2024-09-16T16:50:43.538025+0000","last_fullsized":"2024-09-16T16:50:43.538025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.556212+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:50:43.556212+0000","last_peered":"2024-09-16T16:50:43.556212+0000","last_clean":"2024-09-16T16:50:43.556212+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:50:43.556212+0000","last_undegraded":"2024-09-16T16:50:43.556212+0000","last_fullsized":"2024-09-16T16:50:43.556212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'229","reported_seq":241,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.613579+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:50:43.613579+0000","last_peered":"2024-09-16T16:50:43.613579+0000","last_clean":"2024-09-16T16:50:43.613579+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:50:43.613579+0000","last_undegraded":"2024-09-16T16:50:43.613579+0000","last_fullsized":"2024-09-16T16:50:43.613579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":687,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'202","reported_seq":214,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.598892+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:50:43.598892+0000","last_peered":"2024-09-16T16:50:43.598892+0000","last_clean":"2024-09-16T16:50:43.598892+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:50:43.598892+0000","last_undegraded":"2024-09-16T16:50:43.598892+0000","last_fullsized":"2024-09-16T16:50:43.598892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'212","reported_seq":224,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.691975+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:50:43.691975+0000","last_peered":"2024-09-16T16:50:43.691975+0000","last_clean":"2024-09-16T16:50:43.691975+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:50:43.691975+0000","last_undegraded":"2024-09-16T16:50:43.691975+0000","last_fullsized":"2024-09-16T16:50:43.691975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":13568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.728488+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:50:10.728488+0000","last_peered":"2024-09-16T16:50:10.728488+0000","last_clean":"2024-09-16T16:50:10.728488+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:50:10.728488+0000","last_undegraded":"2024-09-16T16:50:10.728488+0000","last_fullsized":"2024-09-16T16:50:10.728488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'220","reported_seq":232,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.527429+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:50:43.527429+0000","last_peered":"2024-09-16T16:50:43.527429+0000","last_clean":"2024-09-16T16:50:43.527429+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:50:43.527429+0000","last_undegraded":"2024-09-16T16:50:43.527429+0000","last_fullsized":"2024-09-16T16:50:43.527429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'213","reported_seq":225,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.749768+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:50:43.749768+0000","last_peered":"2024-09-16T16:50:43.749768+0000","last_clean":"2024-09-16T16:50:43.749768+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:50:43.749768+0000","last_undegraded":"2024-09-16T16:50:43.749768+0000","last_fullsized":"2024-09-16T16:50:43.749768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"35'257","reported_seq":269,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.810559+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:50:43.810559+0000","last_peered":"2024-09-16T16:50:43.810559+0000","last_clean":"2024-09-16T16:50:43.810559+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:50:43.810559+0000","last_undegraded":"2024-09-16T16:50:43.810559+0000","last_fullsized":"2024-09-16T16:50:43.810559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'230","reported_seq":242,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.501428+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:50:43.501428+0000","last_peered":"2024-09-16T16:50:43.501428+0000","last_clean":"2024-09-16T16:50:43.501428+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:50:43.501428+0000","last_undegraded":"2024-09-16T16:50:43.501428+0000","last_fullsized":"2024-09-16T16:50:43.501428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":230,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.736350+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:50:10.736350+0000","last_peered":"2024-09-16T16:50:10.736350+0000","last_clean":"2024-09-16T16:50:10.736350+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:50:10.736350+0000","last_undegraded":"2024-09-16T16:50:10.736350+0000","last_fullsized":"2024-09-16T16:50:10.736350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'235","reported_seq":247,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.653151+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:50:43.653151+0000","last_peered":"2024-09-16T16:50:43.653151+0000","last_clean":"2024-09-16T16:50:43.653151+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:50:43.653151+0000","last_undegraded":"2024-09-16T16:50:43.653151+0000","last_fullsized":"2024-09-16T16:50:43.653151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.733288+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:50:10.733288+0000","last_peered":"2024-09-16T16:50:10.733288+0000","last_clean":"2024-09-16T16:50:10.733288+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:50:10.733288+0000","last_undegraded":"2024-09-16T16:50:10.733288+0000","last_fullsized":"2024-09-16T16:50:10.733288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'232","reported_seq":244,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.360957+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:50:43.360957+0000","last_peered":"2024-09-16T16:50:43.360957+0000","last_clean":"2024-09-16T16:50:43.360957+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:50:43.360957+0000","last_undegraded":"2024-09-16T16:50:43.360957+0000","last_fullsized":"2024-09-16T16:50:43.360957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":14848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.734335+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:50:10.734335+0000","last_peered":"2024-09-16T16:50:10.734335+0000","last_clean":"2024-09-16T16:50:10.734335+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:50:10.734335+0000","last_undegraded":"2024-09-16T16:50:10.734335+0000","last_fullsized":"2024-09-16T16:50:10.734335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'237","reported_seq":249,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:43.485205+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:50:43.485205+0000","last_peered":"2024-09-16T16:50:43.485205+0000","last_clean":"2024-09-16T16:50:43.485205+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:50:43.485205+0000","last_undegraded":"2024-09-16T16:50:43.485205+0000","last_fullsized":"2024-09-16T16:50:43.485205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":237,"num_write_kb":15168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":238813184,"num_objects":3644,"num_object_clones":0,"num_object_copies":10932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3644,"num_write_kb":233216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760002560,"internally_reserved":0,"allocated":1451491328,"data_stored":1451491328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3644,"ondisk_log_size":3644,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212760264704,"internally_reserved":0,"allocated":1451229184,"data_stored":1451229184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":372364,"kb_used_data":372364,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51925364,"statfs":{"total":53552873472,"available":53171572736,"internally_reserved":0,"allocated":381300736,"data_stored":381300736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":291848,"kb_used_data":291848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52005880,"statfs":{"total":53552873472,"available":53254021120,"internally_reserved":0,"allocated":298852352,"data_stored":298852352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":376328,"kb_used_data":376328,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51921400,"statfs":{"total":53552873472,"available":53167513600,"internally_reserved":0,"allocated":385359872,"data_stored":385359872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":341840,"kb_used_data":341840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51955888,"statfs":{"total":53552873472,"available":53202829312,"internally_reserved":0,"allocated":350044160,"data_stored":350044160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53161041920,"internally_reserved":0,"allocated":391831552,"data_stored":391831552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53156925440,"internally_reserved":0,"allocated":395948032,"data_stored":395948032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53160910848,"internally_reserved":0,"allocated":391962624,"data_stored":391962624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53197021184,"internally_reserved":0,"allocated":355852288,"data_stored":355852288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53156794368,"internally_reserved":0,"allocated":396079104,"data_stored":396079104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53245407232,"internally_reserved":0,"allocated":307466240,"data_stored":307466240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53160779776,"internally_reserved":0,"allocated":392093696,"data_stored":392093696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:07.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 6263 6247 6.84913 5.875 0.177506 0.145775 2024-09-16T16:51:08.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 6362 6346 6.83771 6.1875 0.0831702 0.145999 2024-09-16T16:51:09.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:09.570+0000 7f494e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:09.579+0000 7f494e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:09.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 6462 6446 6.82774 6.25 0.177041 0.146197 2024-09-16T16:51:10.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:51:10.790887+0000 min lat: 0.0239766 max lat: 0.775385 avg lat: 0.146496 2024-09-16T16:51:10.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:51:10.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 6559 6543 6.81498 6.0625 0.23636 0.146496 2024-09-16T16:51:11.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 6662 6646 6.80878 6.4375 0.0702712 0.146673 2024-09-16T16:51:12.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:12.227+0000 7f78e76c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:12.239+0000 7f78e76c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:12.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:12.789 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:51:12.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 6760 6744 6.79774 6.125 0.225876 0.146865 2024-09-16T16:51:12.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:12.967+0000 7f83e8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:12.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:12.987+0000 7f83e8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:13.698 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:51:13.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:51:13.790 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 6861 6845 6.79003 6.3125 0.0654532 0.147011 2024-09-16T16:51:13.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:13.872+0000 7f4af4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:13.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:13.886+0000 7f4af4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:14.703 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:51:14.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:51:14.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:14.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 6951 6935 6.77182 5.625 0.220123 0.14741 2024-09-16T16:51:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:14.910+0000 7f0245aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:14.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:14.934+0000 7f0245aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:14.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:14.967+0000 7ff1f5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:14.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:14.983+0000 7ff1f5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:51:15.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:51:15.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 7035 7019 6.7484 5.25 0.0551825 0.147911 2024-09-16T16:51:15.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:15.904+0000 7fa8070a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:15.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:15.926+0000 7fa8070a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:16.722 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:51:16.752 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:51:16.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:16.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 7140 7124 6.74557 6.5625 0.213465 0.148044 2024-09-16T16:51:16.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:16.897+0000 7fd2aaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:16.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:16.907+0000 7fd2aaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:17.214 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:17.241 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-16T16:51:16.723011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450167347,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6941,"num_write_kb":440148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6915,"ondisk_log_size":6915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2636728,"kb_used_data":2636728,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206554184,"statfs":{"total":214211493888,"available":211511484416,"internally_reserved":0,"allocated":2700009472,"data_stored":2700009472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":210763776,"num_objects":3216,"num_object_clones":0,"num_object_copies":9648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3216,"num_write_kb":205824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910839"},"pg_stats":[{"pgid":"4.f","version":"36'412","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.737103+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:13.737103+0000","last_peered":"2024-09-16T16:51:13.737103+0000","last_clean":"2024-09-16T16:51:13.737103+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:13.737103+0000","last_undegraded":"2024-09-16T16:51:13.737103+0000","last_fullsized":"2024-09-16T16:51:13.737103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.739847+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:13.739847+0000","last_peered":"2024-09-16T16:51:13.739847+0000","last_clean":"2024-09-16T16:51:13.739847+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:13.739847+0000","last_undegraded":"2024-09-16T16:51:13.739847+0000","last_fullsized":"2024-09-16T16:51:13.739847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'442","reported_seq":454,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.343572+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:13.343572+0000","last_peered":"2024-09-16T16:51:13.343572+0000","last_clean":"2024-09-16T16:51:13.343572+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:13.343572+0000","last_undegraded":"2024-09-16T16:51:13.343572+0000","last_fullsized":"2024-09-16T16:51:13.343572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769795+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:13.769795+0000","last_peered":"2024-09-16T16:51:13.769795+0000","last_clean":"2024-09-16T16:51:13.769795+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:13.769795+0000","last_undegraded":"2024-09-16T16:51:13.769795+0000","last_fullsized":"2024-09-16T16:51:13.769795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'410","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.114492+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:13.114492+0000","last_peered":"2024-09-16T16:51:13.114492+0000","last_clean":"2024-09-16T16:51:13.114492+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:13.114492+0000","last_undegraded":"2024-09-16T16:51:13.114492+0000","last_fullsized":"2024-09-16T16:51:13.114492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":26240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'432","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.389210+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:13.389210+0000","last_peered":"2024-09-16T16:51:13.389210+0000","last_clean":"2024-09-16T16:51:13.389210+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:13.389210+0000","last_undegraded":"2024-09-16T16:51:13.389210+0000","last_fullsized":"2024-09-16T16:51:13.389210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.732903+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:13.732903+0000","last_peered":"2024-09-16T16:51:13.732903+0000","last_clean":"2024-09-16T16:51:13.732903+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:13.732903+0000","last_undegraded":"2024-09-16T16:51:13.732903+0000","last_fullsized":"2024-09-16T16:51:13.732903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'376","reported_seq":388,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.506014+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:13.506014+0000","last_peered":"2024-09-16T16:51:13.506014+0000","last_clean":"2024-09-16T16:51:13.506014+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:13.506014+0000","last_undegraded":"2024-09-16T16:51:13.506014+0000","last_fullsized":"2024-09-16T16:51:13.506014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.317237+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:13.317237+0000","last_peered":"2024-09-16T16:51:13.317237+0000","last_clean":"2024-09-16T16:51:13.317237+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:13.317237+0000","last_undegraded":"2024-09-16T16:51:13.317237+0000","last_fullsized":"2024-09-16T16:51:13.317237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.764712+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:13.764712+0000","last_peered":"2024-09-16T16:51:13.764712+0000","last_clean":"2024-09-16T16:51:13.764712+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:13.764712+0000","last_undegraded":"2024-09-16T16:51:13.764712+0000","last_fullsized":"2024-09-16T16:51:13.764712+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'409","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.649555+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:13.649555+0000","last_peered":"2024-09-16T16:51:13.649555+0000","last_clean":"2024-09-16T16:51:13.649555+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:13.649555+0000","last_undegraded":"2024-09-16T16:51:13.649555+0000","last_fullsized":"2024-09-16T16:51:13.649555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'421","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742759+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:13.742759+0000","last_peered":"2024-09-16T16:51:13.742759+0000","last_clean":"2024-09-16T16:51:13.742759+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:13.742759+0000","last_undegraded":"2024-09-16T16:51:13.742759+0000","last_fullsized":"2024-09-16T16:51:13.742759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'453","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.738200+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:13.738200+0000","last_peered":"2024-09-16T16:51:13.738200+0000","last_clean":"2024-09-16T16:51:13.738200+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:13.738200+0000","last_undegraded":"2024-09-16T16:51:13.738200+0000","last_fullsized":"2024-09-16T16:51:13.738200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'464","reported_seq":476,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.297350+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:13.297350+0000","last_peered":"2024-09-16T16:51:13.297350+0000","last_clean":"2024-09-16T16:51:13.297350+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:13.297350+0000","last_undegraded":"2024-09-16T16:51:13.297350+0000","last_fullsized":"2024-09-16T16:51:13.297350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.745450+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:13.745450+0000","last_peered":"2024-09-16T16:51:13.745450+0000","last_clean":"2024-09-16T16:51:13.745450+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:13.745450+0000","last_undegraded":"2024-09-16T16:51:13.745450+0000","last_fullsized":"2024-09-16T16:51:13.745450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'413","reported_seq":425,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:12.762720+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:12.762720+0000","last_peered":"2024-09-16T16:51:12.762720+0000","last_clean":"2024-09-16T16:51:12.762720+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:12.762720+0000","last_undegraded":"2024-09-16T16:51:12.762720+0000","last_fullsized":"2024-09-16T16:51:12.762720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769058+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:13.769058+0000","last_peered":"2024-09-16T16:51:13.769058+0000","last_clean":"2024-09-16T16:51:13.769058+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:13.769058+0000","last_undegraded":"2024-09-16T16:51:13.769058+0000","last_fullsized":"2024-09-16T16:51:13.769058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.401099+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:13.401099+0000","last_peered":"2024-09-16T16:51:13.401099+0000","last_clean":"2024-09-16T16:51:13.401099+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:13.401099+0000","last_undegraded":"2024-09-16T16:51:13.401099+0000","last_fullsized":"2024-09-16T16:51:13.401099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742413+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:13.742413+0000","last_peered":"2024-09-16T16:51:13.742413+0000","last_clean":"2024-09-16T16:51:13.742413+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:13.742413+0000","last_undegraded":"2024-09-16T16:51:13.742413+0000","last_fullsized":"2024-09-16T16:51:13.742413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.659398+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:13.659398+0000","last_peered":"2024-09-16T16:51:13.659398+0000","last_clean":"2024-09-16T16:51:13.659398+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:13.659398+0000","last_undegraded":"2024-09-16T16:51:13.659398+0000","last_fullsized":"2024-09-16T16:51:13.659398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":449576960,"num_objects":6860,"num_object_clones":0,"num_object_copies":20580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6860,"num_write_kb":439040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484286976,"internally_reserved":0,"allocated":2727206912,"data_stored":2727206912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6860,"ondisk_log_size":6860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484418048,"internally_reserved":0,"allocated":2727075840,"data_stored":2727075840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":714920,"kb_used_data":714920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51582808,"statfs":{"total":53552873472,"available":52820795392,"internally_reserved":0,"allocated":732078080,"data_stored":732078080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":553680,"kb_used_data":553680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51744048,"statfs":{"total":53552873472,"available":52985905152,"internally_reserved":0,"allocated":566968320,"data_stored":566968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":717872,"kb_used_data":717872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579856,"statfs":{"total":53552873472,"available":52817772544,"internally_reserved":0,"allocated":735100928,"data_stored":735100928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":650256,"kb_used_data":650256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51647472,"statfs":{"total":53552873472,"available":52887011328,"internally_reserved":0,"allocated":665862144,"data_stored":665862144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52809519104,"internally_reserved":0,"allocated":743354368,"data_stored":743354368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52809388032,"internally_reserved":0,"allocated":743485440,"data_stored":743485440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:17.243 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:17.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:17.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:17.442+0000 7fcce6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:17.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:17.465+0000 7fcce6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:17.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:17.566+0000 7fb923d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:17.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:17.576+0000 7fb923d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:17.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 7233 7217 6.73164 5.8125 0.0893511 0.148358 2024-09-16T16:51:17.850 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:17.850 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:17.874 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-16T16:51:17.813597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450167347,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6941,"num_write_kb":440148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6915,"ondisk_log_size":6915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2636728,"kb_used_data":2636728,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206554184,"statfs":{"total":214211493888,"available":211511484416,"internally_reserved":0,"allocated":2700009472,"data_stored":2700009472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":210763776,"num_objects":3216,"num_object_clones":0,"num_object_copies":9648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3216,"num_write_kb":205824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.117448"},"pg_stats":[{"pgid":"4.f","version":"36'412","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.737103+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:13.737103+0000","last_peered":"2024-09-16T16:51:13.737103+0000","last_clean":"2024-09-16T16:51:13.737103+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:13.737103+0000","last_undegraded":"2024-09-16T16:51:13.737103+0000","last_fullsized":"2024-09-16T16:51:13.737103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.739847+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:13.739847+0000","last_peered":"2024-09-16T16:51:13.739847+0000","last_clean":"2024-09-16T16:51:13.739847+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:13.739847+0000","last_undegraded":"2024-09-16T16:51:13.739847+0000","last_fullsized":"2024-09-16T16:51:13.739847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'442","reported_seq":454,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.343572+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:13.343572+0000","last_peered":"2024-09-16T16:51:13.343572+0000","last_clean":"2024-09-16T16:51:13.343572+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:13.343572+0000","last_undegraded":"2024-09-16T16:51:13.343572+0000","last_fullsized":"2024-09-16T16:51:13.343572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769795+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:13.769795+0000","last_peered":"2024-09-16T16:51:13.769795+0000","last_clean":"2024-09-16T16:51:13.769795+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:13.769795+0000","last_undegraded":"2024-09-16T16:51:13.769795+0000","last_fullsized":"2024-09-16T16:51:13.769795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'410","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.114492+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:13.114492+0000","last_peered":"2024-09-16T16:51:13.114492+0000","last_clean":"2024-09-16T16:51:13.114492+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:13.114492+0000","last_undegraded":"2024-09-16T16:51:13.114492+0000","last_fullsized":"2024-09-16T16:51:13.114492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":26240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'432","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.389210+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:13.389210+0000","last_peered":"2024-09-16T16:51:13.389210+0000","last_clean":"2024-09-16T16:51:13.389210+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:13.389210+0000","last_undegraded":"2024-09-16T16:51:13.389210+0000","last_fullsized":"2024-09-16T16:51:13.389210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.732903+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:13.732903+0000","last_peered":"2024-09-16T16:51:13.732903+0000","last_clean":"2024-09-16T16:51:13.732903+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:13.732903+0000","last_undegraded":"2024-09-16T16:51:13.732903+0000","last_fullsized":"2024-09-16T16:51:13.732903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'376","reported_seq":388,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.506014+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:13.506014+0000","last_peered":"2024-09-16T16:51:13.506014+0000","last_clean":"2024-09-16T16:51:13.506014+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:13.506014+0000","last_undegraded":"2024-09-16T16:51:13.506014+0000","last_fullsized":"2024-09-16T16:51:13.506014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.317237+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:13.317237+0000","last_peered":"2024-09-16T16:51:13.317237+0000","last_clean":"2024-09-16T16:51:13.317237+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:13.317237+0000","last_undegraded":"2024-09-16T16:51:13.317237+0000","last_fullsized":"2024-09-16T16:51:13.317237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.764712+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:13.764712+0000","last_peered":"2024-09-16T16:51:13.764712+0000","last_clean":"2024-09-16T16:51:13.764712+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:13.764712+0000","last_undegraded":"2024-09-16T16:51:13.764712+0000","last_fullsized":"2024-09-16T16:51:13.764712+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'409","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.649555+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:13.649555+0000","last_peered":"2024-09-16T16:51:13.649555+0000","last_clean":"2024-09-16T16:51:13.649555+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:13.649555+0000","last_undegraded":"2024-09-16T16:51:13.649555+0000","last_fullsized":"2024-09-16T16:51:13.649555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'421","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742759+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:13.742759+0000","last_peered":"2024-09-16T16:51:13.742759+0000","last_clean":"2024-09-16T16:51:13.742759+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:13.742759+0000","last_undegraded":"2024-09-16T16:51:13.742759+0000","last_fullsized":"2024-09-16T16:51:13.742759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'453","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.738200+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:13.738200+0000","last_peered":"2024-09-16T16:51:13.738200+0000","last_clean":"2024-09-16T16:51:13.738200+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:13.738200+0000","last_undegraded":"2024-09-16T16:51:13.738200+0000","last_fullsized":"2024-09-16T16:51:13.738200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'464","reported_seq":476,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.297350+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:13.297350+0000","last_peered":"2024-09-16T16:51:13.297350+0000","last_clean":"2024-09-16T16:51:13.297350+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:13.297350+0000","last_undegraded":"2024-09-16T16:51:13.297350+0000","last_fullsized":"2024-09-16T16:51:13.297350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.745450+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:13.745450+0000","last_peered":"2024-09-16T16:51:13.745450+0000","last_clean":"2024-09-16T16:51:13.745450+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:13.745450+0000","last_undegraded":"2024-09-16T16:51:13.745450+0000","last_fullsized":"2024-09-16T16:51:13.745450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'413","reported_seq":425,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:12.762720+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:12.762720+0000","last_peered":"2024-09-16T16:51:12.762720+0000","last_clean":"2024-09-16T16:51:12.762720+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:12.762720+0000","last_undegraded":"2024-09-16T16:51:12.762720+0000","last_fullsized":"2024-09-16T16:51:12.762720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769058+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:13.769058+0000","last_peered":"2024-09-16T16:51:13.769058+0000","last_clean":"2024-09-16T16:51:13.769058+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:13.769058+0000","last_undegraded":"2024-09-16T16:51:13.769058+0000","last_fullsized":"2024-09-16T16:51:13.769058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.401099+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:13.401099+0000","last_peered":"2024-09-16T16:51:13.401099+0000","last_clean":"2024-09-16T16:51:13.401099+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:13.401099+0000","last_undegraded":"2024-09-16T16:51:13.401099+0000","last_fullsized":"2024-09-16T16:51:13.401099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742413+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:13.742413+0000","last_peered":"2024-09-16T16:51:13.742413+0000","last_clean":"2024-09-16T16:51:13.742413+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:13.742413+0000","last_undegraded":"2024-09-16T16:51:13.742413+0000","last_fullsized":"2024-09-16T16:51:13.742413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.659398+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:13.659398+0000","last_peered":"2024-09-16T16:51:13.659398+0000","last_clean":"2024-09-16T16:51:13.659398+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:13.659398+0000","last_undegraded":"2024-09-16T16:51:13.659398+0000","last_fullsized":"2024-09-16T16:51:13.659398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":449576960,"num_objects":6860,"num_object_clones":0,"num_object_copies":20580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6860,"num_write_kb":439040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484286976,"internally_reserved":0,"allocated":2727206912,"data_stored":2727206912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6860,"ondisk_log_size":6860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484418048,"internally_reserved":0,"allocated":2727075840,"data_stored":2727075840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":714920,"kb_used_data":714920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51582808,"statfs":{"total":53552873472,"available":52820795392,"internally_reserved":0,"allocated":732078080,"data_stored":732078080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":553680,"kb_used_data":553680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51744048,"statfs":{"total":53552873472,"available":52985905152,"internally_reserved":0,"allocated":566968320,"data_stored":566968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":717872,"kb_used_data":717872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579856,"statfs":{"total":53552873472,"available":52817772544,"internally_reserved":0,"allocated":735100928,"data_stored":735100928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":650256,"kb_used_data":650256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51647472,"statfs":{"total":53552873472,"available":52887011328,"internally_reserved":0,"allocated":665862144,"data_stored":665862144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52809519104,"internally_reserved":0,"allocated":743354368,"data_stored":743354368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52809388032,"internally_reserved":0,"allocated":743485440,"data_stored":743485440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:17.876 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:51:17.876 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:17.876 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:17.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.052+0000 7f6b8c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.066+0000 7f6b8c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.244 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:18.245 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:18.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:18.250 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:18.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:18.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.379+0000 7f5f28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.394+0000 7f5f28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:18.469 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:18.475 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:18.476 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:18.476 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:18.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.653+0000 7f64d3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.669+0000 7f64d3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.737 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:18.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:18.743 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:18.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:18.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 7337 7321 6.72822 6.5 0.0583014 0.1484 2024-09-16T16:51:18.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.885+0000 7f3b1fe9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:18.898+0000 7f3b1fe9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:19.017 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:19.022 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:19.022 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:19.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 7444 7428 6.72762 6.6875 0.107378 0.148414 2024-09-16T16:51:20.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:20.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:20.310+0000 7f1f3e074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:20.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:20.318+0000 7f1f3e074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:20.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 7553 7537 6.72883 6.8125 0.223071 0.148408 2024-09-16T16:51:21.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 7661 7645 6.72911 6.75 0.111066 0.148425 2024-09-16T16:51:22.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 7771 7755 6.73113 6.875 0.140233 0.148365 2024-09-16T16:51:22.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:23.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:23.011+0000 7f309ff08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:23.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:23.018+0000 7f309ff08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:23.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 7880 7864 6.73224 6.8125 0.0933192 0.148397 2024-09-16T16:51:24.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:24.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:24.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:24.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:24.190+0000 7f8392063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:24.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:24.205+0000 7f8392063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:24.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:24.577 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:24.604 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-16T16:51:23.814731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450167347,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6941,"num_write_kb":440148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6915,"ondisk_log_size":6915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2636728,"kb_used_data":2636728,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206554184,"statfs":{"total":214211493888,"available":211511484416,"internally_reserved":0,"allocated":2700009472,"data_stored":2700009472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.100671"},"pg_stats":[{"pgid":"4.f","version":"36'412","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.737103+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:13.737103+0000","last_peered":"2024-09-16T16:51:13.737103+0000","last_clean":"2024-09-16T16:51:13.737103+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:13.737103+0000","last_undegraded":"2024-09-16T16:51:13.737103+0000","last_fullsized":"2024-09-16T16:51:13.737103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.739847+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:13.739847+0000","last_peered":"2024-09-16T16:51:13.739847+0000","last_clean":"2024-09-16T16:51:13.739847+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:13.739847+0000","last_undegraded":"2024-09-16T16:51:13.739847+0000","last_fullsized":"2024-09-16T16:51:13.739847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'442","reported_seq":454,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.343572+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:13.343572+0000","last_peered":"2024-09-16T16:51:13.343572+0000","last_clean":"2024-09-16T16:51:13.343572+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:13.343572+0000","last_undegraded":"2024-09-16T16:51:13.343572+0000","last_fullsized":"2024-09-16T16:51:13.343572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769795+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:13.769795+0000","last_peered":"2024-09-16T16:51:13.769795+0000","last_clean":"2024-09-16T16:51:13.769795+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:13.769795+0000","last_undegraded":"2024-09-16T16:51:13.769795+0000","last_fullsized":"2024-09-16T16:51:13.769795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'410","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.114492+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:13.114492+0000","last_peered":"2024-09-16T16:51:13.114492+0000","last_clean":"2024-09-16T16:51:13.114492+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:13.114492+0000","last_undegraded":"2024-09-16T16:51:13.114492+0000","last_fullsized":"2024-09-16T16:51:13.114492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":26240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'432","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.389210+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:13.389210+0000","last_peered":"2024-09-16T16:51:13.389210+0000","last_clean":"2024-09-16T16:51:13.389210+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:13.389210+0000","last_undegraded":"2024-09-16T16:51:13.389210+0000","last_fullsized":"2024-09-16T16:51:13.389210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.732903+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:13.732903+0000","last_peered":"2024-09-16T16:51:13.732903+0000","last_clean":"2024-09-16T16:51:13.732903+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:13.732903+0000","last_undegraded":"2024-09-16T16:51:13.732903+0000","last_fullsized":"2024-09-16T16:51:13.732903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'376","reported_seq":388,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.506014+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:13.506014+0000","last_peered":"2024-09-16T16:51:13.506014+0000","last_clean":"2024-09-16T16:51:13.506014+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:13.506014+0000","last_undegraded":"2024-09-16T16:51:13.506014+0000","last_fullsized":"2024-09-16T16:51:13.506014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.317237+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:13.317237+0000","last_peered":"2024-09-16T16:51:13.317237+0000","last_clean":"2024-09-16T16:51:13.317237+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:13.317237+0000","last_undegraded":"2024-09-16T16:51:13.317237+0000","last_fullsized":"2024-09-16T16:51:13.317237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.764712+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:13.764712+0000","last_peered":"2024-09-16T16:51:13.764712+0000","last_clean":"2024-09-16T16:51:13.764712+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:13.764712+0000","last_undegraded":"2024-09-16T16:51:13.764712+0000","last_fullsized":"2024-09-16T16:51:13.764712+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'409","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.649555+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:13.649555+0000","last_peered":"2024-09-16T16:51:13.649555+0000","last_clean":"2024-09-16T16:51:13.649555+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:13.649555+0000","last_undegraded":"2024-09-16T16:51:13.649555+0000","last_fullsized":"2024-09-16T16:51:13.649555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'421","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742759+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:13.742759+0000","last_peered":"2024-09-16T16:51:13.742759+0000","last_clean":"2024-09-16T16:51:13.742759+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:13.742759+0000","last_undegraded":"2024-09-16T16:51:13.742759+0000","last_fullsized":"2024-09-16T16:51:13.742759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'453","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.738200+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:13.738200+0000","last_peered":"2024-09-16T16:51:13.738200+0000","last_clean":"2024-09-16T16:51:13.738200+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:13.738200+0000","last_undegraded":"2024-09-16T16:51:13.738200+0000","last_fullsized":"2024-09-16T16:51:13.738200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'464","reported_seq":476,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.297350+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:13.297350+0000","last_peered":"2024-09-16T16:51:13.297350+0000","last_clean":"2024-09-16T16:51:13.297350+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:13.297350+0000","last_undegraded":"2024-09-16T16:51:13.297350+0000","last_fullsized":"2024-09-16T16:51:13.297350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.745450+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:13.745450+0000","last_peered":"2024-09-16T16:51:13.745450+0000","last_clean":"2024-09-16T16:51:13.745450+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:13.745450+0000","last_undegraded":"2024-09-16T16:51:13.745450+0000","last_fullsized":"2024-09-16T16:51:13.745450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'413","reported_seq":425,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:12.762720+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:12.762720+0000","last_peered":"2024-09-16T16:51:12.762720+0000","last_clean":"2024-09-16T16:51:12.762720+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:12.762720+0000","last_undegraded":"2024-09-16T16:51:12.762720+0000","last_fullsized":"2024-09-16T16:51:12.762720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769058+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:13.769058+0000","last_peered":"2024-09-16T16:51:13.769058+0000","last_clean":"2024-09-16T16:51:13.769058+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:13.769058+0000","last_undegraded":"2024-09-16T16:51:13.769058+0000","last_fullsized":"2024-09-16T16:51:13.769058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.401099+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:13.401099+0000","last_peered":"2024-09-16T16:51:13.401099+0000","last_clean":"2024-09-16T16:51:13.401099+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:13.401099+0000","last_undegraded":"2024-09-16T16:51:13.401099+0000","last_fullsized":"2024-09-16T16:51:13.401099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742413+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:13.742413+0000","last_peered":"2024-09-16T16:51:13.742413+0000","last_clean":"2024-09-16T16:51:13.742413+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:13.742413+0000","last_undegraded":"2024-09-16T16:51:13.742413+0000","last_fullsized":"2024-09-16T16:51:13.742413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.659398+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:13.659398+0000","last_peered":"2024-09-16T16:51:13.659398+0000","last_clean":"2024-09-16T16:51:13.659398+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:13.659398+0000","last_undegraded":"2024-09-16T16:51:13.659398+0000","last_fullsized":"2024-09-16T16:51:13.659398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":449576960,"num_objects":6860,"num_object_clones":0,"num_object_copies":20580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6860,"num_write_kb":439040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484286976,"internally_reserved":0,"allocated":2727206912,"data_stored":2727206912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6860,"ondisk_log_size":6860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484418048,"internally_reserved":0,"allocated":2727075840,"data_stored":2727075840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":714920,"kb_used_data":714920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51582808,"statfs":{"total":53552873472,"available":52820795392,"internally_reserved":0,"allocated":732078080,"data_stored":732078080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":553680,"kb_used_data":553680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51744048,"statfs":{"total":53552873472,"available":52985905152,"internally_reserved":0,"allocated":566968320,"data_stored":566968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":717872,"kb_used_data":717872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579856,"statfs":{"total":53552873472,"available":52817772544,"internally_reserved":0,"allocated":735100928,"data_stored":735100928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":650256,"kb_used_data":650256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51647472,"statfs":{"total":53552873472,"available":52887011328,"internally_reserved":0,"allocated":665862144,"data_stored":665862144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52809519104,"internally_reserved":0,"allocated":743354368,"data_stored":743354368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52809388032,"internally_reserved":0,"allocated":743485440,"data_stored":743485440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:24.791 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 7980 7964 6.72571 6.25 0.175386 0.148525 2024-09-16T16:51:25.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:25.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:25.630+0000 7f68dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:25.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:25.638+0000 7f68dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:25.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 8076 8060 6.71603 6 0.217364 0.148637 2024-09-16T16:51:26.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 8188 8172 6.71976 7 0.0620257 0.148618 2024-09-16T16:51:27.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 8299 8283 6.72258 6.9375 0.0834349 0.148578 2024-09-16T16:51:28.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:28.287+0000 7f55f0551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:28.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:28.295+0000 7f55f0551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:28.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 8402 8386 6.71891 6.4375 0.0915374 0.148601 2024-09-16T16:51:29.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:29.606 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:29.607 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:29.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:29.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:29.764+0000 7fee13cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:29.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:29.781+0000 7fee13cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:29.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 8514 8498 6.72246 7 0.14483 0.148616 2024-09-16T16:51:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:29.897 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:29.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:29.900 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:29.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:30.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.073+0000 7ff676991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.088+0000 7ff676991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:30.252 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:30.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:30.255 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:30.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:30.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.400+0000 7fec1ab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.413+0000 7fec1ab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:30.578 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:30.581 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:30.581 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:30.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:30.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.741+0000 7f5adf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.759+0000 7f5adf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:51:30.792788+0000 min lat: 0.0239766 max lat: 0.775385 avg lat: 0.14883 2024-09-16T16:51:30.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:51:30.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 8610 8594 6.71343 6 0.126284 0.14883 2024-09-16T16:51:30.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:30.864 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:30.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:30.867 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:30.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.953+0000 7f6b82223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:30.963+0000 7f6b82223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:31.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 8717 8701 6.7131 6.6875 0.146015 0.148812 2024-09-16T16:51:32.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 8833 8817 6.71964 7.25 0.0836058 0.148665 2024-09-16T16:51:33.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:33.598+0000 7f5dbe2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:33.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:33.608+0000 7f5dbe2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:33.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 8945 8929 6.72301 7 0.108643 0.148612 2024-09-16T16:51:34.792 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 9051 9035 6.72183 6.625 0.0835159 0.148586 2024-09-16T16:51:35.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 9164 9148 6.72583 7.0625 0.1011 0.148526 2024-09-16T16:51:35.867 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:35.867 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:35.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:36.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:36.031+0000 7fb409391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:36.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:36.048+0000 7fb403fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:36.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:36.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:36.267+0000 7f4ace991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:36.279+0000 7f4ace991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:36.424 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:36.425 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:36.445 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-16T16:51:35.817380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450167347,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6941,"num_write_kb":440148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6915,"ondisk_log_size":6915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2636728,"kb_used_data":2636728,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206554184,"statfs":{"total":214211493888,"available":211511484416,"internally_reserved":0,"allocated":2700009472,"data_stored":2700009472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002648"},"pg_stats":[{"pgid":"4.f","version":"36'412","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.737103+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:13.737103+0000","last_peered":"2024-09-16T16:51:13.737103+0000","last_clean":"2024-09-16T16:51:13.737103+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:13.737103+0000","last_undegraded":"2024-09-16T16:51:13.737103+0000","last_fullsized":"2024-09-16T16:51:13.737103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.739847+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:13.739847+0000","last_peered":"2024-09-16T16:51:13.739847+0000","last_clean":"2024-09-16T16:51:13.739847+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:13.739847+0000","last_undegraded":"2024-09-16T16:51:13.739847+0000","last_fullsized":"2024-09-16T16:51:13.739847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'442","reported_seq":454,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.343572+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:13.343572+0000","last_peered":"2024-09-16T16:51:13.343572+0000","last_clean":"2024-09-16T16:51:13.343572+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:13.343572+0000","last_undegraded":"2024-09-16T16:51:13.343572+0000","last_fullsized":"2024-09-16T16:51:13.343572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769795+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:13.769795+0000","last_peered":"2024-09-16T16:51:13.769795+0000","last_clean":"2024-09-16T16:51:13.769795+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:13.769795+0000","last_undegraded":"2024-09-16T16:51:13.769795+0000","last_fullsized":"2024-09-16T16:51:13.769795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'410","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.114492+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:13.114492+0000","last_peered":"2024-09-16T16:51:13.114492+0000","last_clean":"2024-09-16T16:51:13.114492+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:13.114492+0000","last_undegraded":"2024-09-16T16:51:13.114492+0000","last_fullsized":"2024-09-16T16:51:13.114492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":26240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'432","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.389210+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:13.389210+0000","last_peered":"2024-09-16T16:51:13.389210+0000","last_clean":"2024-09-16T16:51:13.389210+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:13.389210+0000","last_undegraded":"2024-09-16T16:51:13.389210+0000","last_fullsized":"2024-09-16T16:51:13.389210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.732903+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:13.732903+0000","last_peered":"2024-09-16T16:51:13.732903+0000","last_clean":"2024-09-16T16:51:13.732903+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:13.732903+0000","last_undegraded":"2024-09-16T16:51:13.732903+0000","last_fullsized":"2024-09-16T16:51:13.732903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'376","reported_seq":388,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.506014+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:13.506014+0000","last_peered":"2024-09-16T16:51:13.506014+0000","last_clean":"2024-09-16T16:51:13.506014+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:13.506014+0000","last_undegraded":"2024-09-16T16:51:13.506014+0000","last_fullsized":"2024-09-16T16:51:13.506014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.317237+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:13.317237+0000","last_peered":"2024-09-16T16:51:13.317237+0000","last_clean":"2024-09-16T16:51:13.317237+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:13.317237+0000","last_undegraded":"2024-09-16T16:51:13.317237+0000","last_fullsized":"2024-09-16T16:51:13.317237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.764712+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:13.764712+0000","last_peered":"2024-09-16T16:51:13.764712+0000","last_clean":"2024-09-16T16:51:13.764712+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:13.764712+0000","last_undegraded":"2024-09-16T16:51:13.764712+0000","last_fullsized":"2024-09-16T16:51:13.764712+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'409","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.649555+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:13.649555+0000","last_peered":"2024-09-16T16:51:13.649555+0000","last_clean":"2024-09-16T16:51:13.649555+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:13.649555+0000","last_undegraded":"2024-09-16T16:51:13.649555+0000","last_fullsized":"2024-09-16T16:51:13.649555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'421","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742759+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:13.742759+0000","last_peered":"2024-09-16T16:51:13.742759+0000","last_clean":"2024-09-16T16:51:13.742759+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:13.742759+0000","last_undegraded":"2024-09-16T16:51:13.742759+0000","last_fullsized":"2024-09-16T16:51:13.742759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'453","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.738200+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:13.738200+0000","last_peered":"2024-09-16T16:51:13.738200+0000","last_clean":"2024-09-16T16:51:13.738200+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:13.738200+0000","last_undegraded":"2024-09-16T16:51:13.738200+0000","last_fullsized":"2024-09-16T16:51:13.738200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'464","reported_seq":476,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.297350+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:13.297350+0000","last_peered":"2024-09-16T16:51:13.297350+0000","last_clean":"2024-09-16T16:51:13.297350+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:13.297350+0000","last_undegraded":"2024-09-16T16:51:13.297350+0000","last_fullsized":"2024-09-16T16:51:13.297350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.745450+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:13.745450+0000","last_peered":"2024-09-16T16:51:13.745450+0000","last_clean":"2024-09-16T16:51:13.745450+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:13.745450+0000","last_undegraded":"2024-09-16T16:51:13.745450+0000","last_fullsized":"2024-09-16T16:51:13.745450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'413","reported_seq":425,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:12.762720+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:12.762720+0000","last_peered":"2024-09-16T16:51:12.762720+0000","last_clean":"2024-09-16T16:51:12.762720+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:12.762720+0000","last_undegraded":"2024-09-16T16:51:12.762720+0000","last_fullsized":"2024-09-16T16:51:12.762720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769058+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:13.769058+0000","last_peered":"2024-09-16T16:51:13.769058+0000","last_clean":"2024-09-16T16:51:13.769058+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:13.769058+0000","last_undegraded":"2024-09-16T16:51:13.769058+0000","last_fullsized":"2024-09-16T16:51:13.769058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.401099+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:13.401099+0000","last_peered":"2024-09-16T16:51:13.401099+0000","last_clean":"2024-09-16T16:51:13.401099+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:13.401099+0000","last_undegraded":"2024-09-16T16:51:13.401099+0000","last_fullsized":"2024-09-16T16:51:13.401099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742413+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:13.742413+0000","last_peered":"2024-09-16T16:51:13.742413+0000","last_clean":"2024-09-16T16:51:13.742413+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:13.742413+0000","last_undegraded":"2024-09-16T16:51:13.742413+0000","last_fullsized":"2024-09-16T16:51:13.742413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.659398+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:13.659398+0000","last_peered":"2024-09-16T16:51:13.659398+0000","last_clean":"2024-09-16T16:51:13.659398+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:13.659398+0000","last_undegraded":"2024-09-16T16:51:13.659398+0000","last_fullsized":"2024-09-16T16:51:13.659398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":449576960,"num_objects":6860,"num_object_clones":0,"num_object_copies":20580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6860,"num_write_kb":439040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484286976,"internally_reserved":0,"allocated":2727206912,"data_stored":2727206912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6860,"ondisk_log_size":6860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484418048,"internally_reserved":0,"allocated":2727075840,"data_stored":2727075840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":714920,"kb_used_data":714920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51582808,"statfs":{"total":53552873472,"available":52820795392,"internally_reserved":0,"allocated":732078080,"data_stored":732078080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":553680,"kb_used_data":553680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51744048,"statfs":{"total":53552873472,"available":52985905152,"internally_reserved":0,"allocated":566968320,"data_stored":566968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":717872,"kb_used_data":717872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579856,"statfs":{"total":53552873472,"available":52817772544,"internally_reserved":0,"allocated":735100928,"data_stored":735100928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":650256,"kb_used_data":650256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51647472,"statfs":{"total":53552873472,"available":52887011328,"internally_reserved":0,"allocated":665862144,"data_stored":665862144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52809519104,"internally_reserved":0,"allocated":743354368,"data_stored":743354368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52809388032,"internally_reserved":0,"allocated":743485440,"data_stored":743485440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:36.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 9255 9239 6.71375 5.6875 0.321448 0.148772 2024-09-16T16:51:37.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 9364 9348 6.71488 6.8125 0.199 0.148766 2024-09-16T16:51:38.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 9471 9455 6.71456 6.6875 0.099164 0.148724 2024-09-16T16:51:38.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:39.013+0000 7fe145e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:39.020+0000 7fe145e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:39.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 9582 9566 6.71706 6.9375 0.265888 0.148721 2024-09-16T16:51:40.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 15 9680 9665 6.71117 6.1875 0.101619 0.148842 2024-09-16T16:51:41.448 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:41.448 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:41.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:41.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:41.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:41.557+0000 7ff54d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:41.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:41.566+0000 7ff54d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:41.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:41.598+0000 7f9aaa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:41.603+0000 7f9aaa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:41.768 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:41.769 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:41.781 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-16T16:51:39.818201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450167347,"num_objects":6864,"num_object_clones":0,"num_object_copies":20592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6941,"num_write_kb":440148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6915,"ondisk_log_size":6915,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2636728,"kb_used_data":2636728,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206554184,"statfs":{"total":214211493888,"available":211511484416,"internally_reserved":0,"allocated":2700009472,"data_stored":2700009472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"4.f","version":"36'412","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.737103+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:13.737103+0000","last_peered":"2024-09-16T16:51:13.737103+0000","last_clean":"2024-09-16T16:51:13.737103+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:13.737103+0000","last_undegraded":"2024-09-16T16:51:13.737103+0000","last_fullsized":"2024-09-16T16:51:13.737103+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.739847+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:13.739847+0000","last_peered":"2024-09-16T16:51:13.739847+0000","last_clean":"2024-09-16T16:51:13.739847+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:13.739847+0000","last_undegraded":"2024-09-16T16:51:13.739847+0000","last_fullsized":"2024-09-16T16:51:13.739847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"35'442","reported_seq":454,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.343572+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:13.343572+0000","last_peered":"2024-09-16T16:51:13.343572+0000","last_clean":"2024-09-16T16:51:13.343572+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:13.343572+0000","last_undegraded":"2024-09-16T16:51:13.343572+0000","last_fullsized":"2024-09-16T16:51:13.343572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28966912,"num_objects":442,"num_object_clones":0,"num_object_copies":1326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":442,"num_write_kb":28288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"35'448","reported_seq":463,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769795+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:13.769795+0000","last_peered":"2024-09-16T16:51:13.769795+0000","last_clean":"2024-09-16T16:51:13.769795+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:13.769795+0000","last_undegraded":"2024-09-16T16:51:13.769795+0000","last_fullsized":"2024-09-16T16:51:13.769795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"35'410","reported_seq":422,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.114492+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:13.114492+0000","last_peered":"2024-09-16T16:51:13.114492+0000","last_clean":"2024-09-16T16:51:13.114492+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:13.114492+0000","last_undegraded":"2024-09-16T16:51:13.114492+0000","last_fullsized":"2024-09-16T16:51:13.114492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":26240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"35'432","reported_seq":444,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.389210+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:13.389210+0000","last_peered":"2024-09-16T16:51:13.389210+0000","last_clean":"2024-09-16T16:51:13.389210+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:13.389210+0000","last_undegraded":"2024-09-16T16:51:13.389210+0000","last_fullsized":"2024-09-16T16:51:13.389210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.732903+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:13.732903+0000","last_peered":"2024-09-16T16:51:13.732903+0000","last_clean":"2024-09-16T16:51:13.732903+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:13.732903+0000","last_undegraded":"2024-09-16T16:51:13.732903+0000","last_fullsized":"2024-09-16T16:51:13.732903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"35'376","reported_seq":388,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.506014+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:13.506014+0000","last_peered":"2024-09-16T16:51:13.506014+0000","last_clean":"2024-09-16T16:51:13.506014+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:13.506014+0000","last_undegraded":"2024-09-16T16:51:13.506014+0000","last_fullsized":"2024-09-16T16:51:13.506014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'435","reported_seq":447,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.317237+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:13.317237+0000","last_peered":"2024-09-16T16:51:13.317237+0000","last_clean":"2024-09-16T16:51:13.317237+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:13.317237+0000","last_undegraded":"2024-09-16T16:51:13.317237+0000","last_fullsized":"2024-09-16T16:51:13.317237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.764712+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:13.764712+0000","last_peered":"2024-09-16T16:51:13.764712+0000","last_clean":"2024-09-16T16:51:13.764712+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:13.764712+0000","last_undegraded":"2024-09-16T16:51:13.764712+0000","last_fullsized":"2024-09-16T16:51:13.764712+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.738245+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:50:10.738245+0000","last_peered":"2024-09-16T16:50:10.738245+0000","last_clean":"2024-09-16T16:50:10.738245+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:50:10.738245+0000","last_undegraded":"2024-09-16T16:50:10.738245+0000","last_fullsized":"2024-09-16T16:50:10.738245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"35'409","reported_seq":421,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.649555+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:13.649555+0000","last_peered":"2024-09-16T16:51:13.649555+0000","last_clean":"2024-09-16T16:51:13.649555+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:13.649555+0000","last_undegraded":"2024-09-16T16:51:13.649555+0000","last_fullsized":"2024-09-16T16:51:13.649555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'421","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742759+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:13.742759+0000","last_peered":"2024-09-16T16:51:13.742759+0000","last_clean":"2024-09-16T16:51:13.742759+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:13.742759+0000","last_undegraded":"2024-09-16T16:51:13.742759+0000","last_fullsized":"2024-09-16T16:51:13.742759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.729866+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:50:10.729866+0000","last_peered":"2024-09-16T16:50:10.729866+0000","last_clean":"2024-09-16T16:50:10.729866+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:50:10.729866+0000","last_undegraded":"2024-09-16T16:50:10.729866+0000","last_fullsized":"2024-09-16T16:50:10.729866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'453","reported_seq":468,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.738200+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:13.738200+0000","last_peered":"2024-09-16T16:51:13.738200+0000","last_clean":"2024-09-16T16:51:13.738200+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:13.738200+0000","last_undegraded":"2024-09-16T16:51:13.738200+0000","last_fullsized":"2024-09-16T16:51:13.738200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29687808,"num_objects":453,"num_object_clones":0,"num_object_copies":1359,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737056+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:50:10.737056+0000","last_peered":"2024-09-16T16:50:10.737056+0000","last_clean":"2024-09-16T16:50:10.737056+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:50:10.737056+0000","last_undegraded":"2024-09-16T16:50:10.737056+0000","last_fullsized":"2024-09-16T16:50:10.737056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"35'464","reported_seq":476,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.297350+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:13.297350+0000","last_peered":"2024-09-16T16:51:13.297350+0000","last_clean":"2024-09-16T16:51:13.297350+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:13.297350+0000","last_undegraded":"2024-09-16T16:51:13.297350+0000","last_fullsized":"2024-09-16T16:51:13.297350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.745450+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:13.745450+0000","last_peered":"2024-09-16T16:51:13.745450+0000","last_clean":"2024-09-16T16:51:13.745450+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:13.745450+0000","last_undegraded":"2024-09-16T16:51:13.745450+0000","last_fullsized":"2024-09-16T16:51:13.745450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"35'413","reported_seq":425,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:12.762720+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:12.762720+0000","last_peered":"2024-09-16T16:51:12.762720+0000","last_clean":"2024-09-16T16:51:12.762720+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:12.762720+0000","last_undegraded":"2024-09-16T16:51:12.762720+0000","last_fullsized":"2024-09-16T16:51:12.762720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.769058+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:13.769058+0000","last_peered":"2024-09-16T16:51:13.769058+0000","last_clean":"2024-09-16T16:51:13.769058+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:13.769058+0000","last_undegraded":"2024-09-16T16:51:13.769058+0000","last_fullsized":"2024-09-16T16:51:13.769058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.401099+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:13.401099+0000","last_peered":"2024-09-16T16:51:13.401099+0000","last_clean":"2024-09-16T16:51:13.401099+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:13.401099+0000","last_undegraded":"2024-09-16T16:51:13.401099+0000","last_fullsized":"2024-09-16T16:51:13.401099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.742413+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:13.742413+0000","last_peered":"2024-09-16T16:51:13.742413+0000","last_clean":"2024-09-16T16:51:13.742413+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:13.742413+0000","last_undegraded":"2024-09-16T16:51:13.742413+0000","last_fullsized":"2024-09-16T16:51:13.742413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"35'431","reported_seq":443,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:51:13.659398+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:13.659398+0000","last_peered":"2024-09-16T16:51:13.659398+0000","last_clean":"2024-09-16T16:51:13.659398+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:13.659398+0000","last_undegraded":"2024-09-16T16:51:13.659398+0000","last_fullsized":"2024-09-16T16:51:13.659398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28246016,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":27584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-16T16:50:10.737018+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:50:10.737018+0000","last_peered":"2024-09-16T16:50:10.737018+0000","last_clean":"2024-09-16T16:50:10.737018+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:50:10.737018+0000","last_undegraded":"2024-09-16T16:50:10.737018+0000","last_fullsized":"2024-09-16T16:50:10.737018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":449576960,"num_objects":6860,"num_object_clones":0,"num_object_copies":20580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6860,"num_write_kb":439040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484286976,"internally_reserved":0,"allocated":2727206912,"data_stored":2727206912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6860,"ondisk_log_size":6860,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211484418048,"internally_reserved":0,"allocated":2727075840,"data_stored":2727075840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":714920,"kb_used_data":714920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51582808,"statfs":{"total":53552873472,"available":52820795392,"internally_reserved":0,"allocated":732078080,"data_stored":732078080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":553680,"kb_used_data":553680,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51744048,"statfs":{"total":53552873472,"available":52985905152,"internally_reserved":0,"allocated":566968320,"data_stored":566968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":717872,"kb_used_data":717872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579856,"statfs":{"total":53552873472,"available":52817772544,"internally_reserved":0,"allocated":735100928,"data_stored":735100928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":650256,"kb_used_data":650256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51647472,"statfs":{"total":53552873472,"available":52887011328,"internally_reserved":0,"allocated":665862144,"data_stored":665862144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52809519104,"internally_reserved":0,"allocated":743354368,"data_stored":743354368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52882735104,"internally_reserved":0,"allocated":670138368,"data_stored":670138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52809388032,"internally_reserved":0,"allocated":743485440,"data_stored":743485440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52980727808,"internally_reserved":0,"allocated":572145664,"data_stored":572145664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52811436032,"internally_reserved":0,"allocated":741437440,"data_stored":741437440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:41.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1128 2024-09-16T16:51:41.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 9680 2024-09-16T16:51:41.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-16T16:51:41.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-16T16:51:41.793 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 6.7138 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.546607 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 7.9375 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 5.25 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 107 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 8.74571 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 127 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 84 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.148841 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.0838879 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 0.775385 2024-09-16T16:51:41.794 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0239766 2024-09-16T16:51:41.829 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:51:43.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:43.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:43.860+0000 7f3365191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:43.867+0000 7f3365191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:46.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:46.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:46.494+0000 7f512a09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:46.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:46.504+0000 7f512a09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:46.783 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:46.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:46.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:46.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:46.941+0000 7f37e2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:46.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:46.956+0000 7f37e2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:47.304 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:47.305 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:47.329 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-16T16:51:45.819355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616497739,"num_objects":9403,"num_object_clones":0,"num_object_copies":28209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10044,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10018,"ondisk_log_size":10018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3682496,"kb_used_data":3682496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205508416,"statfs":{"total":214211493888,"available":210440617984,"internally_reserved":0,"allocated":3770875904,"data_stored":3770875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":166330392,"num_objects":2539,"num_object_clones":0,"num_object_copies":7617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3103,"num_write_kb":180481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002425"},"pg_stats":[{"pgid":"4.f","version":"39'594","reported_seq":618,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.698180+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:43.698180+0000","last_peered":"2024-09-16T16:51:43.698180+0000","last_clean":"2024-09-16T16:51:43.698180+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:43.698180+0000","last_undegraded":"2024-09-16T16:51:43.698180+0000","last_fullsized":"2024-09-16T16:51:43.698180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36569088,"num_objects":558,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'655","reported_seq":679,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.803010+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:43.803010+0000","last_peered":"2024-09-16T16:51:43.803010+0000","last_clean":"2024-09-16T16:51:43.803010+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:43.803010+0000","last_undegraded":"2024-09-16T16:51:43.803010+0000","last_fullsized":"2024-09-16T16:51:43.803010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'629","reported_seq":654,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.712724+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:43.712724+0000","last_peered":"2024-09-16T16:51:43.712724+0000","last_clean":"2024-09-16T16:51:43.712724+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:43.712724+0000","last_undegraded":"2024-09-16T16:51:43.712724+0000","last_fullsized":"2024-09-16T16:51:43.712724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38928408,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":629,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'644","reported_seq":668,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.573769+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:43.573769+0000","last_peered":"2024-09-16T16:51:43.573769+0000","last_clean":"2024-09-16T16:51:43.573769+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:43.573769+0000","last_undegraded":"2024-09-16T16:51:43.573769+0000","last_fullsized":"2024-09-16T16:51:43.573769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'612","reported_seq":636,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.246815+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:43.246815+0000","last_peered":"2024-09-16T16:51:43.246815+0000","last_clean":"2024-09-16T16:51:43.246815+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:43.246815+0000","last_undegraded":"2024-09-16T16:51:43.246815+0000","last_fullsized":"2024-09-16T16:51:43.246815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'617","reported_seq":641,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.672222+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:43.672222+0000","last_peered":"2024-09-16T16:51:43.672222+0000","last_clean":"2024-09-16T16:51:43.672222+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:43.672222+0000","last_undegraded":"2024-09-16T16:51:43.672222+0000","last_fullsized":"2024-09-16T16:51:43.672222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'619","reported_seq":643,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.521597+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:43.521597+0000","last_peered":"2024-09-16T16:51:43.521597+0000","last_clean":"2024-09-16T16:51:43.521597+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:43.521597+0000","last_undegraded":"2024-09-16T16:51:43.521597+0000","last_fullsized":"2024-09-16T16:51:43.521597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'562","reported_seq":586,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.241205+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:43.241205+0000","last_peered":"2024-09-16T16:51:43.241205+0000","last_clean":"2024-09-16T16:51:43.241205+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:43.241205+0000","last_undegraded":"2024-09-16T16:51:43.241205+0000","last_fullsized":"2024-09-16T16:51:43.241205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'643","reported_seq":667,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.384341+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:43.384341+0000","last_peered":"2024-09-16T16:51:43.384341+0000","last_clean":"2024-09-16T16:51:43.384341+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:43.384341+0000","last_undegraded":"2024-09-16T16:51:43.384341+0000","last_fullsized":"2024-09-16T16:51:43.384341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'609","reported_seq":633,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.742122+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:43.742122+0000","last_peered":"2024-09-16T16:51:43.742122+0000","last_clean":"2024-09-16T16:51:43.742122+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:43.742122+0000","last_undegraded":"2024-09-16T16:51:43.742122+0000","last_fullsized":"2024-09-16T16:51:43.742122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'615","reported_seq":639,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.617183+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:43.617183+0000","last_peered":"2024-09-16T16:51:43.617183+0000","last_clean":"2024-09-16T16:51:43.617183+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:43.617183+0000","last_undegraded":"2024-09-16T16:51:43.617183+0000","last_fullsized":"2024-09-16T16:51:43.617183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'650","reported_seq":674,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.831311+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:43.831311+0000","last_peered":"2024-09-16T16:51:43.831311+0000","last_clean":"2024-09-16T16:51:43.831311+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:43.831311+0000","last_undegraded":"2024-09-16T16:51:43.831311+0000","last_fullsized":"2024-09-16T16:51:43.831311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'649","reported_seq":673,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.448003+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:43.448003+0000","last_peered":"2024-09-16T16:51:43.448003+0000","last_clean":"2024-09-16T16:51:43.448003+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:43.448003+0000","last_undegraded":"2024-09-16T16:51:43.448003+0000","last_fullsized":"2024-09-16T16:51:43.448003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'605","reported_seq":629,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.496486+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:43.496486+0000","last_peered":"2024-09-16T16:51:43.496486+0000","last_clean":"2024-09-16T16:51:43.496486+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:43.496486+0000","last_undegraded":"2024-09-16T16:51:43.496486+0000","last_fullsized":"2024-09-16T16:51:43.496486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'623","reported_seq":647,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.639482+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:43.639482+0000","last_peered":"2024-09-16T16:51:43.639482+0000","last_clean":"2024-09-16T16:51:43.639482+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:43.639482+0000","last_undegraded":"2024-09-16T16:51:43.639482+0000","last_fullsized":"2024-09-16T16:51:43.639482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'637","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.707552+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:43.707552+0000","last_peered":"2024-09-16T16:51:43.707552+0000","last_clean":"2024-09-16T16:51:43.707552+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:43.707552+0000","last_undegraded":"2024-09-16T16:51:43.707552+0000","last_fullsized":"2024-09-16T16:51:43.707552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":615907352,"num_objects":9399,"num_object_clones":0,"num_object_copies":28197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9963,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472951808,"internally_reserved":0,"allocated":3738542080,"data_stored":3738542080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9963,"ondisk_log_size":9963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472427520,"internally_reserved":0,"allocated":3739066368,"data_stored":3739066368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1001240,"kb_used_data":1001240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51296488,"statfs":{"total":53552873472,"available":52527603712,"internally_reserved":0,"allocated":1025269760,"data_stored":1025269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":765300,"kb_used_data":765300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51532428,"statfs":{"total":53552873472,"available":52769206272,"internally_reserved":0,"allocated":783667200,"data_stored":783667200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1004200,"kb_used_data":1004200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51293528,"statfs":{"total":53552873472,"available":52524572672,"internally_reserved":0,"allocated":1028300800,"data_stored":1028300800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":911756,"kb_used_data":911756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51385972,"statfs":{"total":53552873472,"available":52619235328,"internally_reserved":0,"allocated":933638144,"data_stored":933638144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52623896576,"internally_reserved":0,"allocated":928976896,"data_stored":928976896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52777140224,"internally_reserved":0,"allocated":775733248,"data_stored":775733248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52624158720,"internally_reserved":0,"allocated":928714752,"data_stored":928714752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52777402368,"internally_reserved":0,"allocated":775471104,"data_stored":775471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:48.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:49.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:49.077+0000 7f74bc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:49.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:49.084+0000 7f74bc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:51.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:51.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:51.668+0000 7f4baf511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:51.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:51.676+0000 7f4baf511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:52.331 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:52.332 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:52.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:52.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:52.504+0000 7ff9e8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:52.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:52.517+0000 7ff9e8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:52.805 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:51:52.805 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:51:52.823 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-16T16:51:51.820611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616497739,"num_objects":9403,"num_object_clones":0,"num_object_copies":28209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10044,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10018,"ondisk_log_size":10018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3682496,"kb_used_data":3682496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205508416,"statfs":{"total":214211493888,"available":210440617984,"internally_reserved":0,"allocated":3770875904,"data_stored":3770875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":166330392,"num_objects":2539,"num_object_clones":0,"num_object_copies":7617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3103,"num_write_kb":180481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002410"},"pg_stats":[{"pgid":"4.f","version":"39'594","reported_seq":618,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.698180+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:43.698180+0000","last_peered":"2024-09-16T16:51:43.698180+0000","last_clean":"2024-09-16T16:51:43.698180+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:43.698180+0000","last_undegraded":"2024-09-16T16:51:43.698180+0000","last_fullsized":"2024-09-16T16:51:43.698180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36569088,"num_objects":558,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'655","reported_seq":679,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.803010+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:43.803010+0000","last_peered":"2024-09-16T16:51:43.803010+0000","last_clean":"2024-09-16T16:51:43.803010+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:43.803010+0000","last_undegraded":"2024-09-16T16:51:43.803010+0000","last_fullsized":"2024-09-16T16:51:43.803010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'629","reported_seq":654,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.712724+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:43.712724+0000","last_peered":"2024-09-16T16:51:43.712724+0000","last_clean":"2024-09-16T16:51:43.712724+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:43.712724+0000","last_undegraded":"2024-09-16T16:51:43.712724+0000","last_fullsized":"2024-09-16T16:51:43.712724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38928408,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":629,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'644","reported_seq":668,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.573769+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:43.573769+0000","last_peered":"2024-09-16T16:51:43.573769+0000","last_clean":"2024-09-16T16:51:43.573769+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:43.573769+0000","last_undegraded":"2024-09-16T16:51:43.573769+0000","last_fullsized":"2024-09-16T16:51:43.573769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'612","reported_seq":636,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.246815+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:43.246815+0000","last_peered":"2024-09-16T16:51:43.246815+0000","last_clean":"2024-09-16T16:51:43.246815+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:43.246815+0000","last_undegraded":"2024-09-16T16:51:43.246815+0000","last_fullsized":"2024-09-16T16:51:43.246815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'617","reported_seq":641,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.672222+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:43.672222+0000","last_peered":"2024-09-16T16:51:43.672222+0000","last_clean":"2024-09-16T16:51:43.672222+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:43.672222+0000","last_undegraded":"2024-09-16T16:51:43.672222+0000","last_fullsized":"2024-09-16T16:51:43.672222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'619","reported_seq":643,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.521597+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:43.521597+0000","last_peered":"2024-09-16T16:51:43.521597+0000","last_clean":"2024-09-16T16:51:43.521597+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:43.521597+0000","last_undegraded":"2024-09-16T16:51:43.521597+0000","last_fullsized":"2024-09-16T16:51:43.521597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'562","reported_seq":586,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.241205+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:43.241205+0000","last_peered":"2024-09-16T16:51:43.241205+0000","last_clean":"2024-09-16T16:51:43.241205+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:43.241205+0000","last_undegraded":"2024-09-16T16:51:43.241205+0000","last_fullsized":"2024-09-16T16:51:43.241205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'643","reported_seq":667,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.384341+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:43.384341+0000","last_peered":"2024-09-16T16:51:43.384341+0000","last_clean":"2024-09-16T16:51:43.384341+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:43.384341+0000","last_undegraded":"2024-09-16T16:51:43.384341+0000","last_fullsized":"2024-09-16T16:51:43.384341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'609","reported_seq":633,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.742122+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:43.742122+0000","last_peered":"2024-09-16T16:51:43.742122+0000","last_clean":"2024-09-16T16:51:43.742122+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:43.742122+0000","last_undegraded":"2024-09-16T16:51:43.742122+0000","last_fullsized":"2024-09-16T16:51:43.742122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'615","reported_seq":639,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.617183+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:43.617183+0000","last_peered":"2024-09-16T16:51:43.617183+0000","last_clean":"2024-09-16T16:51:43.617183+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:43.617183+0000","last_undegraded":"2024-09-16T16:51:43.617183+0000","last_fullsized":"2024-09-16T16:51:43.617183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'650","reported_seq":674,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.831311+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:43.831311+0000","last_peered":"2024-09-16T16:51:43.831311+0000","last_clean":"2024-09-16T16:51:43.831311+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:43.831311+0000","last_undegraded":"2024-09-16T16:51:43.831311+0000","last_fullsized":"2024-09-16T16:51:43.831311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'649","reported_seq":673,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.448003+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:43.448003+0000","last_peered":"2024-09-16T16:51:43.448003+0000","last_clean":"2024-09-16T16:51:43.448003+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:43.448003+0000","last_undegraded":"2024-09-16T16:51:43.448003+0000","last_fullsized":"2024-09-16T16:51:43.448003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'605","reported_seq":629,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.496486+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:43.496486+0000","last_peered":"2024-09-16T16:51:43.496486+0000","last_clean":"2024-09-16T16:51:43.496486+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:43.496486+0000","last_undegraded":"2024-09-16T16:51:43.496486+0000","last_fullsized":"2024-09-16T16:51:43.496486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'623","reported_seq":647,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.639482+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:43.639482+0000","last_peered":"2024-09-16T16:51:43.639482+0000","last_clean":"2024-09-16T16:51:43.639482+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:43.639482+0000","last_undegraded":"2024-09-16T16:51:43.639482+0000","last_fullsized":"2024-09-16T16:51:43.639482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'637","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.707552+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:43.707552+0000","last_peered":"2024-09-16T16:51:43.707552+0000","last_clean":"2024-09-16T16:51:43.707552+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:43.707552+0000","last_undegraded":"2024-09-16T16:51:43.707552+0000","last_fullsized":"2024-09-16T16:51:43.707552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":615907352,"num_objects":9399,"num_object_clones":0,"num_object_copies":28197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9963,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472951808,"internally_reserved":0,"allocated":3738542080,"data_stored":3738542080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9963,"ondisk_log_size":9963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472427520,"internally_reserved":0,"allocated":3739066368,"data_stored":3739066368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1001240,"kb_used_data":1001240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51296488,"statfs":{"total":53552873472,"available":52527603712,"internally_reserved":0,"allocated":1025269760,"data_stored":1025269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":765300,"kb_used_data":765300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51532428,"statfs":{"total":53552873472,"available":52769206272,"internally_reserved":0,"allocated":783667200,"data_stored":783667200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1004200,"kb_used_data":1004200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51293528,"statfs":{"total":53552873472,"available":52524572672,"internally_reserved":0,"allocated":1028300800,"data_stored":1028300800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":911756,"kb_used_data":911756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51385972,"statfs":{"total":53552873472,"available":52619235328,"internally_reserved":0,"allocated":933638144,"data_stored":933638144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52623896576,"internally_reserved":0,"allocated":928976896,"data_stored":928976896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52777140224,"internally_reserved":0,"allocated":775733248,"data_stored":775733248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52624158720,"internally_reserved":0,"allocated":928714752,"data_stored":928714752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52777402368,"internally_reserved":0,"allocated":775471104,"data_stored":775471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:54.210 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:54.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:54.337+0000 7f8e8df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:54.344+0000 7f8e8df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:56.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:57.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:57.109+0000 7f962deac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:57.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:57.116+0000 7f962deac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:57.825 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:57.825 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:57.825 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:57.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:58.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.007+0000 7f2adeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.023+0000 7f2adeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:58.172 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:58.176 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:58.176 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:58.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:58.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.327+0000 7f7035b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.341+0000 7f7035b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:58.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:58.489 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:58.491 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:58.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:58.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:58.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.630+0000 7f7cdc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.643+0000 7f7cdc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:58.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:58.673 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:58.676 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:58.677 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:58.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:58.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.825+0000 7ffb12ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:58.838+0000 7ffb12ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.892 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:51:58.893 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:51:58.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:58.897 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:59.656 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:59.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:59.820+0000 7f9fcea88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:59.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:51:59.831+0000 7f9fcea88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:02.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:02.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:02.543+0000 7f33fa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:02.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:02.554+0000 7f33fa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:03.898 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:03.899 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:03.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:04.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:04.076+0000 7f4f91111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:04.086+0000 7f4f91111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.459 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:04.460 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:04.483 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-16T16:52:03.823083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616497739,"num_objects":9403,"num_object_clones":0,"num_object_copies":28209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10044,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10018,"ondisk_log_size":10018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3682496,"kb_used_data":3682496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205508416,"statfs":{"total":214211493888,"available":210440617984,"internally_reserved":0,"allocated":3770875904,"data_stored":3770875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002471"},"pg_stats":[{"pgid":"4.f","version":"39'594","reported_seq":618,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.698180+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:43.698180+0000","last_peered":"2024-09-16T16:51:43.698180+0000","last_clean":"2024-09-16T16:51:43.698180+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:43.698180+0000","last_undegraded":"2024-09-16T16:51:43.698180+0000","last_fullsized":"2024-09-16T16:51:43.698180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36569088,"num_objects":558,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'655","reported_seq":679,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.803010+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:43.803010+0000","last_peered":"2024-09-16T16:51:43.803010+0000","last_clean":"2024-09-16T16:51:43.803010+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:43.803010+0000","last_undegraded":"2024-09-16T16:51:43.803010+0000","last_fullsized":"2024-09-16T16:51:43.803010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'629","reported_seq":654,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.712724+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:43.712724+0000","last_peered":"2024-09-16T16:51:43.712724+0000","last_clean":"2024-09-16T16:51:43.712724+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:43.712724+0000","last_undegraded":"2024-09-16T16:51:43.712724+0000","last_fullsized":"2024-09-16T16:51:43.712724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38928408,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":629,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'644","reported_seq":668,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.573769+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:43.573769+0000","last_peered":"2024-09-16T16:51:43.573769+0000","last_clean":"2024-09-16T16:51:43.573769+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:43.573769+0000","last_undegraded":"2024-09-16T16:51:43.573769+0000","last_fullsized":"2024-09-16T16:51:43.573769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'612","reported_seq":636,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.246815+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:43.246815+0000","last_peered":"2024-09-16T16:51:43.246815+0000","last_clean":"2024-09-16T16:51:43.246815+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:43.246815+0000","last_undegraded":"2024-09-16T16:51:43.246815+0000","last_fullsized":"2024-09-16T16:51:43.246815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'617","reported_seq":641,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.672222+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:43.672222+0000","last_peered":"2024-09-16T16:51:43.672222+0000","last_clean":"2024-09-16T16:51:43.672222+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:43.672222+0000","last_undegraded":"2024-09-16T16:51:43.672222+0000","last_fullsized":"2024-09-16T16:51:43.672222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'619","reported_seq":643,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.521597+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:43.521597+0000","last_peered":"2024-09-16T16:51:43.521597+0000","last_clean":"2024-09-16T16:51:43.521597+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:43.521597+0000","last_undegraded":"2024-09-16T16:51:43.521597+0000","last_fullsized":"2024-09-16T16:51:43.521597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'562","reported_seq":586,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.241205+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:43.241205+0000","last_peered":"2024-09-16T16:51:43.241205+0000","last_clean":"2024-09-16T16:51:43.241205+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:43.241205+0000","last_undegraded":"2024-09-16T16:51:43.241205+0000","last_fullsized":"2024-09-16T16:51:43.241205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'643","reported_seq":667,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.384341+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:43.384341+0000","last_peered":"2024-09-16T16:51:43.384341+0000","last_clean":"2024-09-16T16:51:43.384341+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:43.384341+0000","last_undegraded":"2024-09-16T16:51:43.384341+0000","last_fullsized":"2024-09-16T16:51:43.384341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'609","reported_seq":633,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.742122+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:43.742122+0000","last_peered":"2024-09-16T16:51:43.742122+0000","last_clean":"2024-09-16T16:51:43.742122+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:43.742122+0000","last_undegraded":"2024-09-16T16:51:43.742122+0000","last_fullsized":"2024-09-16T16:51:43.742122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'615","reported_seq":639,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.617183+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:43.617183+0000","last_peered":"2024-09-16T16:51:43.617183+0000","last_clean":"2024-09-16T16:51:43.617183+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:43.617183+0000","last_undegraded":"2024-09-16T16:51:43.617183+0000","last_fullsized":"2024-09-16T16:51:43.617183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'650","reported_seq":674,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.831311+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:43.831311+0000","last_peered":"2024-09-16T16:51:43.831311+0000","last_clean":"2024-09-16T16:51:43.831311+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:43.831311+0000","last_undegraded":"2024-09-16T16:51:43.831311+0000","last_fullsized":"2024-09-16T16:51:43.831311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'649","reported_seq":673,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.448003+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:43.448003+0000","last_peered":"2024-09-16T16:51:43.448003+0000","last_clean":"2024-09-16T16:51:43.448003+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:43.448003+0000","last_undegraded":"2024-09-16T16:51:43.448003+0000","last_fullsized":"2024-09-16T16:51:43.448003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'605","reported_seq":629,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.496486+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:43.496486+0000","last_peered":"2024-09-16T16:51:43.496486+0000","last_clean":"2024-09-16T16:51:43.496486+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:43.496486+0000","last_undegraded":"2024-09-16T16:51:43.496486+0000","last_fullsized":"2024-09-16T16:51:43.496486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'623","reported_seq":647,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.639482+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:43.639482+0000","last_peered":"2024-09-16T16:51:43.639482+0000","last_clean":"2024-09-16T16:51:43.639482+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:43.639482+0000","last_undegraded":"2024-09-16T16:51:43.639482+0000","last_fullsized":"2024-09-16T16:51:43.639482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'637","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.707552+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:43.707552+0000","last_peered":"2024-09-16T16:51:43.707552+0000","last_clean":"2024-09-16T16:51:43.707552+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:43.707552+0000","last_undegraded":"2024-09-16T16:51:43.707552+0000","last_fullsized":"2024-09-16T16:51:43.707552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":615907352,"num_objects":9399,"num_object_clones":0,"num_object_copies":28197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9963,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472951808,"internally_reserved":0,"allocated":3738542080,"data_stored":3738542080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9963,"ondisk_log_size":9963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472427520,"internally_reserved":0,"allocated":3739066368,"data_stored":3739066368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1001240,"kb_used_data":1001240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51296488,"statfs":{"total":53552873472,"available":52527603712,"internally_reserved":0,"allocated":1025269760,"data_stored":1025269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":765300,"kb_used_data":765300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51532428,"statfs":{"total":53552873472,"available":52769206272,"internally_reserved":0,"allocated":783667200,"data_stored":783667200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1004200,"kb_used_data":1004200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51293528,"statfs":{"total":53552873472,"available":52524572672,"internally_reserved":0,"allocated":1028300800,"data_stored":1028300800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":911756,"kb_used_data":911756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51385972,"statfs":{"total":53552873472,"available":52619235328,"internally_reserved":0,"allocated":933638144,"data_stored":933638144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52623896576,"internally_reserved":0,"allocated":928976896,"data_stored":928976896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52777140224,"internally_reserved":0,"allocated":775733248,"data_stored":775733248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52624158720,"internally_reserved":0,"allocated":928714752,"data_stored":928714752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52777402368,"internally_reserved":0,"allocated":775471104,"data_stored":775471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:05.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:05.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:05.286+0000 7f7e1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:05.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:05.296+0000 7f7e1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:07.789 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:07.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:07.925+0000 7f59f3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:07.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:07.935+0000 7f59f3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:09.485 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:09.485 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:09.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:09.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:09.640+0000 7f3b96c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:09.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:09.653+0000 7f3b96c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:09.951 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:09.951 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:09.975 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-16T16:52:09.824175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":616497739,"num_objects":9403,"num_object_clones":0,"num_object_copies":28209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10044,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10018,"ondisk_log_size":10018,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3682496,"kb_used_data":3682496,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205508416,"statfs":{"total":214211493888,"available":210440617984,"internally_reserved":0,"allocated":3770875904,"data_stored":3770875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002327"},"pg_stats":[{"pgid":"4.f","version":"39'594","reported_seq":618,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.698180+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:43.698180+0000","last_peered":"2024-09-16T16:51:43.698180+0000","last_clean":"2024-09-16T16:51:43.698180+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:43.698180+0000","last_undegraded":"2024-09-16T16:51:43.698180+0000","last_fullsized":"2024-09-16T16:51:43.698180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36569088,"num_objects":558,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'655","reported_seq":679,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.803010+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:43.803010+0000","last_peered":"2024-09-16T16:51:43.803010+0000","last_clean":"2024-09-16T16:51:43.803010+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:43.803010+0000","last_undegraded":"2024-09-16T16:51:43.803010+0000","last_fullsized":"2024-09-16T16:51:43.803010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'629","reported_seq":654,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.712724+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:51:43.712724+0000","last_peered":"2024-09-16T16:51:43.712724+0000","last_clean":"2024-09-16T16:51:43.712724+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:51:43.712724+0000","last_undegraded":"2024-09-16T16:51:43.712724+0000","last_fullsized":"2024-09-16T16:51:43.712724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38928408,"num_objects":595,"num_object_clones":0,"num_object_copies":1785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":629,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'644","reported_seq":668,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.573769+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:43.573769+0000","last_peered":"2024-09-16T16:51:43.573769+0000","last_clean":"2024-09-16T16:51:43.573769+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:43.573769+0000","last_undegraded":"2024-09-16T16:51:43.573769+0000","last_fullsized":"2024-09-16T16:51:43.573769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'612","reported_seq":636,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.246815+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:51:43.246815+0000","last_peered":"2024-09-16T16:51:43.246815+0000","last_clean":"2024-09-16T16:51:43.246815+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:51:43.246815+0000","last_undegraded":"2024-09-16T16:51:43.246815+0000","last_fullsized":"2024-09-16T16:51:43.246815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'617","reported_seq":641,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.672222+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:51:43.672222+0000","last_peered":"2024-09-16T16:51:43.672222+0000","last_clean":"2024-09-16T16:51:43.672222+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:51:43.672222+0000","last_undegraded":"2024-09-16T16:51:43.672222+0000","last_fullsized":"2024-09-16T16:51:43.672222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'619","reported_seq":643,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.521597+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:51:43.521597+0000","last_peered":"2024-09-16T16:51:43.521597+0000","last_clean":"2024-09-16T16:51:43.521597+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:51:43.521597+0000","last_undegraded":"2024-09-16T16:51:43.521597+0000","last_fullsized":"2024-09-16T16:51:43.521597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'562","reported_seq":586,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.241205+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:51:43.241205+0000","last_peered":"2024-09-16T16:51:43.241205+0000","last_clean":"2024-09-16T16:51:43.241205+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:51:43.241205+0000","last_undegraded":"2024-09-16T16:51:43.241205+0000","last_fullsized":"2024-09-16T16:51:43.241205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'643","reported_seq":667,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.384341+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:51:43.384341+0000","last_peered":"2024-09-16T16:51:43.384341+0000","last_clean":"2024-09-16T16:51:43.384341+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:51:43.384341+0000","last_undegraded":"2024-09-16T16:51:43.384341+0000","last_fullsized":"2024-09-16T16:51:43.384341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40304640,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":643,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'609","reported_seq":633,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.742122+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:51:43.742122+0000","last_peered":"2024-09-16T16:51:43.742122+0000","last_clean":"2024-09-16T16:51:43.742122+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:51:43.742122+0000","last_undegraded":"2024-09-16T16:51:43.742122+0000","last_fullsized":"2024-09-16T16:51:43.742122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'615","reported_seq":639,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.617183+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:43.617183+0000","last_peered":"2024-09-16T16:51:43.617183+0000","last_clean":"2024-09-16T16:51:43.617183+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:43.617183+0000","last_undegraded":"2024-09-16T16:51:43.617183+0000","last_fullsized":"2024-09-16T16:51:43.617183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'650","reported_seq":674,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.831311+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:43.831311+0000","last_peered":"2024-09-16T16:51:43.831311+0000","last_clean":"2024-09-16T16:51:43.831311+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:43.831311+0000","last_undegraded":"2024-09-16T16:51:43.831311+0000","last_fullsized":"2024-09-16T16:51:43.831311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'649","reported_seq":673,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.448003+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:51:43.448003+0000","last_peered":"2024-09-16T16:51:43.448003+0000","last_clean":"2024-09-16T16:51:43.448003+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:51:43.448003+0000","last_undegraded":"2024-09-16T16:51:43.448003+0000","last_fullsized":"2024-09-16T16:51:43.448003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'605","reported_seq":629,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.496486+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:51:43.496486+0000","last_peered":"2024-09-16T16:51:43.496486+0000","last_clean":"2024-09-16T16:51:43.496486+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:51:43.496486+0000","last_undegraded":"2024-09-16T16:51:43.496486+0000","last_fullsized":"2024-09-16T16:51:43.496486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'623","reported_seq":647,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.639482+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:51:43.639482+0000","last_peered":"2024-09-16T16:51:43.639482+0000","last_clean":"2024-09-16T16:51:43.639482+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:51:43.639482+0000","last_undegraded":"2024-09-16T16:51:43.639482+0000","last_fullsized":"2024-09-16T16:51:43.639482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'637","reported_seq":661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.707552+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:51:43.707552+0000","last_peered":"2024-09-16T16:51:43.707552+0000","last_clean":"2024-09-16T16:51:43.707552+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:51:43.707552+0000","last_undegraded":"2024-09-16T16:51:43.707552+0000","last_fullsized":"2024-09-16T16:51:43.707552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":637,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":615907352,"num_objects":9399,"num_object_clones":0,"num_object_copies":28197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9963,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472951808,"internally_reserved":0,"allocated":3738542080,"data_stored":3738542080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9963,"ondisk_log_size":9963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210472427520,"internally_reserved":0,"allocated":3739066368,"data_stored":3739066368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1001240,"kb_used_data":1001240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51296488,"statfs":{"total":53552873472,"available":52527603712,"internally_reserved":0,"allocated":1025269760,"data_stored":1025269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":765300,"kb_used_data":765300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51532428,"statfs":{"total":53552873472,"available":52769206272,"internally_reserved":0,"allocated":783667200,"data_stored":783667200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1004200,"kb_used_data":1004200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51293528,"statfs":{"total":53552873472,"available":52524572672,"internally_reserved":0,"allocated":1028300800,"data_stored":1028300800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":911756,"kb_used_data":911756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51385972,"statfs":{"total":53552873472,"available":52619235328,"internally_reserved":0,"allocated":933638144,"data_stored":933638144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52623896576,"internally_reserved":0,"allocated":928976896,"data_stored":928976896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52777140224,"internally_reserved":0,"allocated":775733248,"data_stored":775733248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52624158720,"internally_reserved":0,"allocated":928714752,"data_stored":928714752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52534091776,"internally_reserved":0,"allocated":1018781696,"data_stored":1018781696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52777402368,"internally_reserved":0,"allocated":775471104,"data_stored":775471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:10.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:10.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:10.682+0000 7f88e5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:10.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:10.694+0000 7f88e5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:13.338 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:13.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:13.485+0000 7feb0a246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:13.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:13.492+0000 7feb0a246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:14.977 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:14.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:14.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:15.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:15.122+0000 7f9bd3e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:15.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:15.133+0000 7f9bd3e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:15.503 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:15.504 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:15.523 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-16T16:52:13.825010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":442171979,"num_objects":6743,"num_object_clones":0,"num_object_copies":20229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12704,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12678,"ondisk_log_size":12678,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2907984,"kb_used_data":2907984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206282928,"statfs":{"total":214211493888,"available":211233718272,"internally_reserved":0,"allocated":2977775616,"data_stored":2977775616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-174325760,"num_objects":-2660,"num_object_clones":0,"num_object_copies":-7980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2660,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002269"},"pg_stats":[{"pgid":"4.f","version":"39'594","reported_seq":618,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.698180+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:51:43.698180+0000","last_peered":"2024-09-16T16:51:43.698180+0000","last_clean":"2024-09-16T16:51:43.698180+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:51:43.698180+0000","last_undegraded":"2024-09-16T16:51:43.698180+0000","last_fullsized":"2024-09-16T16:51:43.698180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36569088,"num_objects":558,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":594,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'655","reported_seq":679,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.803010+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:51:43.803010+0000","last_peered":"2024-09-16T16:51:43.803010+0000","last_clean":"2024-09-16T16:51:43.803010+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:51:43.803010+0000","last_undegraded":"2024-09-16T16:51:43.803010+0000","last_fullsized":"2024-09-16T16:51:43.803010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'897","reported_seq":922,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.571441+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:13.571441+0000","last_peered":"2024-09-16T16:52:13.571441+0000","last_clean":"2024-09-16T16:52:13.571441+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:13.571441+0000","last_undegraded":"2024-09-16T16:52:13.571441+0000","last_fullsized":"2024-09-16T16:52:13.571441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364760,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":897,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'644","reported_seq":668,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.573769+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:51:43.573769+0000","last_peered":"2024-09-16T16:51:43.573769+0000","last_clean":"2024-09-16T16:51:43.573769+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:51:43.573769+0000","last_undegraded":"2024-09-16T16:51:43.573769+0000","last_fullsized":"2024-09-16T16:51:43.573769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'840","reported_seq":864,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.415870+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:13.415870+0000","last_peered":"2024-09-16T16:52:13.415870+0000","last_clean":"2024-09-16T16:52:13.415870+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:13.415870+0000","last_undegraded":"2024-09-16T16:52:13.415870+0000","last_fullsized":"2024-09-16T16:52:13.415870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'869","reported_seq":893,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.569550+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:13.569550+0000","last_peered":"2024-09-16T16:52:13.569550+0000","last_clean":"2024-09-16T16:52:13.569550+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:13.569550+0000","last_undegraded":"2024-09-16T16:52:13.569550+0000","last_fullsized":"2024-09-16T16:52:13.569550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'866","reported_seq":890,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.636131+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:13.636131+0000","last_peered":"2024-09-16T16:52:13.636131+0000","last_clean":"2024-09-16T16:52:13.636131+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:13.636131+0000","last_undegraded":"2024-09-16T16:52:13.636131+0000","last_fullsized":"2024-09-16T16:52:13.636131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'784","reported_seq":808,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.527840+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:13.527840+0000","last_peered":"2024-09-16T16:52:13.527840+0000","last_clean":"2024-09-16T16:52:13.527840+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:13.527840+0000","last_undegraded":"2024-09-16T16:52:13.527840+0000","last_fullsized":"2024-09-16T16:52:13.527840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'875","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.481757+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:13.481757+0000","last_peered":"2024-09-16T16:52:13.481757+0000","last_clean":"2024-09-16T16:52:13.481757+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:13.481757+0000","last_undegraded":"2024-09-16T16:52:13.481757+0000","last_fullsized":"2024-09-16T16:52:13.481757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":875,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'841","reported_seq":865,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.699020+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:13.699020+0000","last_peered":"2024-09-16T16:52:13.699020+0000","last_clean":"2024-09-16T16:52:13.699020+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:13.699020+0000","last_undegraded":"2024-09-16T16:52:13.699020+0000","last_fullsized":"2024-09-16T16:52:13.699020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'615","reported_seq":639,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.617183+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:51:43.617183+0000","last_peered":"2024-09-16T16:51:43.617183+0000","last_clean":"2024-09-16T16:51:43.617183+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:51:43.617183+0000","last_undegraded":"2024-09-16T16:51:43.617183+0000","last_fullsized":"2024-09-16T16:51:43.617183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":615,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'650","reported_seq":674,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:43.831311+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:51:43.831311+0000","last_peered":"2024-09-16T16:51:43.831311+0000","last_clean":"2024-09-16T16:51:43.831311+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:51:43.831311+0000","last_undegraded":"2024-09-16T16:51:43.831311+0000","last_fullsized":"2024-09-16T16:51:43.831311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39190528,"num_objects":598,"num_object_clones":0,"num_object_copies":1794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'891","reported_seq":915,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.716271+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:13.716271+0000","last_peered":"2024-09-16T16:52:13.716271+0000","last_clean":"2024-09-16T16:52:13.716271+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:13.716271+0000","last_undegraded":"2024-09-16T16:52:13.716271+0000","last_fullsized":"2024-09-16T16:52:13.716271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'842","reported_seq":866,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.681705+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:13.681705+0000","last_peered":"2024-09-16T16:52:13.681705+0000","last_clean":"2024-09-16T16:52:13.681705+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:13.681705+0000","last_undegraded":"2024-09-16T16:52:13.681705+0000","last_fullsized":"2024-09-16T16:52:13.681705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'877","reported_seq":901,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.533200+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:13.533200+0000","last_peered":"2024-09-16T16:52:13.533200+0000","last_clean":"2024-09-16T16:52:13.533200+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:13.533200+0000","last_undegraded":"2024-09-16T16:52:13.533200+0000","last_fullsized":"2024-09-16T16:52:13.533200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'883","reported_seq":907,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.146783+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:13.146783+0000","last_peered":"2024-09-16T16:52:13.146783+0000","last_clean":"2024-09-16T16:52:13.146783+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:13.146783+0000","last_undegraded":"2024-09-16T16:52:13.146783+0000","last_fullsized":"2024-09-16T16:52:13.146783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":441581592,"num_objects":6739,"num_object_clones":0,"num_object_copies":20217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12623,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211265589248,"internally_reserved":0,"allocated":2945904640,"data_stored":2945904640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12623,"ondisk_log_size":12623,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211265060864,"internally_reserved":0,"allocated":2946433024,"data_stored":2946433024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1001240,"kb_used_data":1001240,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51296488,"statfs":{"total":53552873472,"available":52527603712,"internally_reserved":0,"allocated":1025269760,"data_stored":1025269760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":765300,"kb_used_data":765300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51532428,"statfs":{"total":53552873472,"available":52769206272,"internally_reserved":0,"allocated":783667200,"data_stored":783667200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":596560,"kb_used_data":596560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51701168,"statfs":{"total":53552873472,"available":52941996032,"internally_reserved":0,"allocated":610877440,"data_stored":610877440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544884,"kb_used_data":544884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51752844,"statfs":{"total":53552873472,"available":52994912256,"internally_reserved":0,"allocated":557961216,"data_stored":557961216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52999847936,"internally_reserved":0,"allocated":553025536,"data_stored":553025536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52950773760,"internally_reserved":0,"allocated":602099712,"data_stored":602099712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52777140224,"internally_reserved":0,"allocated":775733248,"data_stored":775733248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52999983104,"internally_reserved":0,"allocated":552890368,"data_stored":552890368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52950904832,"internally_reserved":0,"allocated":601968640,"data_stored":601968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":52777402368,"internally_reserved":0,"allocated":775471104,"data_stored":775471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52537298944,"internally_reserved":0,"allocated":1015574528,"data_stored":1015574528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:16.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:16.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:16.157+0000 7fcd9a057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:16.165+0000 7fcd9a057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:18.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:18.726+0000 7f9b56791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:18.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:18.733+0000 7f9b56791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:20.525 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:20.525 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:20.525 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:20.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:20.686+0000 7fb52146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:20.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:20.700+0000 7fb52146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:21.051 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:21.071 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-16T16:52:19.826357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":362021451,"num_objects":5520,"num_object_clones":0,"num_object_copies":16560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13927,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13901,"ondisk_log_size":13901,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2191704,"kb_used_data":2191704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206999208,"statfs":{"total":214211493888,"available":211967188992,"internally_reserved":0,"allocated":2244304896,"data_stored":2244304896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-254476288,"num_objects":-3883,"num_object_clones":0,"num_object_copies":-11649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3883,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002600"},"pg_stats":[{"pgid":"4.f","version":"39'829","reported_seq":853,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.700986+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:13.700986+0000","last_peered":"2024-09-16T16:52:13.700986+0000","last_clean":"2024-09-16T16:52:13.700986+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:13.700986+0000","last_undegraded":"2024-09-16T16:52:13.700986+0000","last_fullsized":"2024-09-16T16:52:13.700986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'909","reported_seq":933,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.758120+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:13.758120+0000","last_peered":"2024-09-16T16:52:13.758120+0000","last_clean":"2024-09-16T16:52:13.758120+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:13.758120+0000","last_undegraded":"2024-09-16T16:52:13.758120+0000","last_fullsized":"2024-09-16T16:52:13.758120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":909,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'897","reported_seq":922,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.571441+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:13.571441+0000","last_peered":"2024-09-16T16:52:13.571441+0000","last_clean":"2024-09-16T16:52:13.571441+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:13.571441+0000","last_undegraded":"2024-09-16T16:52:13.571441+0000","last_fullsized":"2024-09-16T16:52:13.571441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364760,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":897,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'885","reported_seq":909,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.545418+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:13.545418+0000","last_peered":"2024-09-16T16:52:13.545418+0000","last_clean":"2024-09-16T16:52:13.545418+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:13.545418+0000","last_undegraded":"2024-09-16T16:52:13.545418+0000","last_fullsized":"2024-09-16T16:52:13.545418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'840","reported_seq":864,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.415870+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:13.415870+0000","last_peered":"2024-09-16T16:52:13.415870+0000","last_clean":"2024-09-16T16:52:13.415870+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:13.415870+0000","last_undegraded":"2024-09-16T16:52:13.415870+0000","last_fullsized":"2024-09-16T16:52:13.415870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'869","reported_seq":893,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.569550+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:13.569550+0000","last_peered":"2024-09-16T16:52:13.569550+0000","last_clean":"2024-09-16T16:52:13.569550+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:13.569550+0000","last_undegraded":"2024-09-16T16:52:13.569550+0000","last_fullsized":"2024-09-16T16:52:13.569550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'866","reported_seq":890,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.636131+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:13.636131+0000","last_peered":"2024-09-16T16:52:13.636131+0000","last_clean":"2024-09-16T16:52:13.636131+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:13.636131+0000","last_undegraded":"2024-09-16T16:52:13.636131+0000","last_fullsized":"2024-09-16T16:52:13.636131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'784","reported_seq":808,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.527840+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:13.527840+0000","last_peered":"2024-09-16T16:52:13.527840+0000","last_clean":"2024-09-16T16:52:13.527840+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:13.527840+0000","last_undegraded":"2024-09-16T16:52:13.527840+0000","last_fullsized":"2024-09-16T16:52:13.527840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'875","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.481757+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:13.481757+0000","last_peered":"2024-09-16T16:52:13.481757+0000","last_clean":"2024-09-16T16:52:13.481757+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:13.481757+0000","last_undegraded":"2024-09-16T16:52:13.481757+0000","last_fullsized":"2024-09-16T16:52:13.481757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":875,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'841","reported_seq":865,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.699020+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:13.699020+0000","last_peered":"2024-09-16T16:52:13.699020+0000","last_clean":"2024-09-16T16:52:13.699020+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:13.699020+0000","last_undegraded":"2024-09-16T16:52:13.699020+0000","last_fullsized":"2024-09-16T16:52:13.699020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'850","reported_seq":874,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.710580+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:13.710580+0000","last_peered":"2024-09-16T16:52:13.710580+0000","last_clean":"2024-09-16T16:52:13.710580+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:13.710580+0000","last_undegraded":"2024-09-16T16:52:13.710580+0000","last_fullsized":"2024-09-16T16:52:13.710580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'908","reported_seq":932,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.751826+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:13.751826+0000","last_peered":"2024-09-16T16:52:13.751826+0000","last_clean":"2024-09-16T16:52:13.751826+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:13.751826+0000","last_undegraded":"2024-09-16T16:52:13.751826+0000","last_fullsized":"2024-09-16T16:52:13.751826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'891","reported_seq":915,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.716271+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:13.716271+0000","last_peered":"2024-09-16T16:52:13.716271+0000","last_clean":"2024-09-16T16:52:13.716271+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:13.716271+0000","last_undegraded":"2024-09-16T16:52:13.716271+0000","last_fullsized":"2024-09-16T16:52:13.716271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'842","reported_seq":866,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.681705+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:13.681705+0000","last_peered":"2024-09-16T16:52:13.681705+0000","last_clean":"2024-09-16T16:52:13.681705+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:13.681705+0000","last_undegraded":"2024-09-16T16:52:13.681705+0000","last_fullsized":"2024-09-16T16:52:13.681705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'877","reported_seq":901,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.533200+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:13.533200+0000","last_peered":"2024-09-16T16:52:13.533200+0000","last_clean":"2024-09-16T16:52:13.533200+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:13.533200+0000","last_undegraded":"2024-09-16T16:52:13.533200+0000","last_fullsized":"2024-09-16T16:52:13.533200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'883","reported_seq":907,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.146783+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:13.146783+0000","last_peered":"2024-09-16T16:52:13.146783+0000","last_clean":"2024-09-16T16:52:13.146783+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:13.146783+0000","last_undegraded":"2024-09-16T16:52:13.146783+0000","last_fullsized":"2024-09-16T16:52:13.146783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":361431064,"num_objects":5516,"num_object_clones":0,"num_object_copies":16548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13846,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211996483584,"internally_reserved":0,"allocated":2215010304,"data_stored":2215010304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13846,"ondisk_log_size":13846,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211996217344,"internally_reserved":0,"allocated":2215276544,"data_stored":2215276544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":598024,"kb_used_data":598024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51699704,"statfs":{"total":53552873472,"available":52940496896,"internally_reserved":0,"allocated":612376576,"data_stored":612376576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":452236,"kb_used_data":452236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51845492,"statfs":{"total":53552873472,"available":53089783808,"internally_reserved":0,"allocated":463089664,"data_stored":463089664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":596560,"kb_used_data":596560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51701168,"statfs":{"total":53552873472,"available":52941996032,"internally_reserved":0,"allocated":610877440,"data_stored":610877440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544884,"kb_used_data":544884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51752844,"statfs":{"total":53552873472,"available":52994912256,"internally_reserved":0,"allocated":557961216,"data_stored":557961216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52999847936,"internally_reserved":0,"allocated":553025536,"data_stored":553025536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52950773760,"internally_reserved":0,"allocated":602099712,"data_stored":602099712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53095948288,"internally_reserved":0,"allocated":456925184,"data_stored":456925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52999983104,"internally_reserved":0,"allocated":552890368,"data_stored":552890368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52950904832,"internally_reserved":0,"allocated":601968640,"data_stored":601968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53095948288,"internally_reserved":0,"allocated":456925184,"data_stored":456925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:21.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:21.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:21.329+0000 7fab45591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:21.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:21.339+0000 7fab45591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:23.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:23.966+0000 7fea34ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:23.975+0000 7fea34ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.073 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:26.074 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:26.074 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:26.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:26.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.225+0000 7fdd956d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.237+0000 7fdd956d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:26.267 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:26.268 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:26.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:26.271 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:26.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:26.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.427+0000 7f741b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.444+0000 7f741b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:26.606 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:26.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:26.610 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:26.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.613+0000 7f6943151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.624+0000 7f6943151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.771+0000 7f00a24d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:26.786+0000 7f00a24d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.010 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:27.010 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:27.011 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:27.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:27.015 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:27.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:27.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:27.202+0000 7fc28ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:27.213+0000 7fc28ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:27.355 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:27.356 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:27.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:27.360 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:29.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:29.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:29.299+0000 7f4188f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:29.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:29.306+0000 7f4188f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:31.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:31.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:31.943+0000 7f32c12fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:31.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:31.950+0000 7f32c12fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.361 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:32.361 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:32.361 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:32.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.484+0000 7fdb404fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.494+0000 7fdb404fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:32.513 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:32.514 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:32.514 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:32.514 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:32.514 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:32.514 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:32.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:32.518 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:32.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:32.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.659+0000 7f0976a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.676+0000 7f0976a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:32.766 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:32.767 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:32.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:32.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.886+0000 7f0e03191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:32.901+0000 7f0e03191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:32.943 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:32.943 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:32.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:33.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:33.097+0000 7f55c84ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:33.116+0000 7f55c84ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:52:33.271 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:52:33.272 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:52:33.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:33.276 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:34.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:34.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:34.368+0000 7f0dd6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:34.377+0000 7f0dd6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:36.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:37.015+0000 7faa42991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:37.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:37.022+0000 7faa42991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:38.277 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:38.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:38.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:38.431+0000 7f0f1c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:38.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:38.446+0000 7f0f1c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:38.823 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:38.823 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:38.839 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-16T16:52:37.830078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":362021451,"num_objects":5520,"num_object_clones":0,"num_object_copies":16560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13927,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13901,"ondisk_log_size":13901,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2191704,"kb_used_data":2191704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206999208,"statfs":{"total":214211493888,"available":211967188992,"internally_reserved":0,"allocated":2244304896,"data_stored":2244304896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002489"},"pg_stats":[{"pgid":"4.f","version":"39'829","reported_seq":853,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.700986+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:13.700986+0000","last_peered":"2024-09-16T16:52:13.700986+0000","last_clean":"2024-09-16T16:52:13.700986+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:13.700986+0000","last_undegraded":"2024-09-16T16:52:13.700986+0000","last_fullsized":"2024-09-16T16:52:13.700986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'909","reported_seq":933,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.758120+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:13.758120+0000","last_peered":"2024-09-16T16:52:13.758120+0000","last_clean":"2024-09-16T16:52:13.758120+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:13.758120+0000","last_undegraded":"2024-09-16T16:52:13.758120+0000","last_fullsized":"2024-09-16T16:52:13.758120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":909,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'897","reported_seq":922,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.571441+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:13.571441+0000","last_peered":"2024-09-16T16:52:13.571441+0000","last_clean":"2024-09-16T16:52:13.571441+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:13.571441+0000","last_undegraded":"2024-09-16T16:52:13.571441+0000","last_fullsized":"2024-09-16T16:52:13.571441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21364760,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":897,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'885","reported_seq":909,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.545418+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:13.545418+0000","last_peered":"2024-09-16T16:52:13.545418+0000","last_clean":"2024-09-16T16:52:13.545418+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:13.545418+0000","last_undegraded":"2024-09-16T16:52:13.545418+0000","last_fullsized":"2024-09-16T16:52:13.545418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'840","reported_seq":864,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.415870+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:13.415870+0000","last_peered":"2024-09-16T16:52:13.415870+0000","last_clean":"2024-09-16T16:52:13.415870+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:13.415870+0000","last_undegraded":"2024-09-16T16:52:13.415870+0000","last_fullsized":"2024-09-16T16:52:13.415870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'869","reported_seq":893,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.569550+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:13.569550+0000","last_peered":"2024-09-16T16:52:13.569550+0000","last_clean":"2024-09-16T16:52:13.569550+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:13.569550+0000","last_undegraded":"2024-09-16T16:52:13.569550+0000","last_fullsized":"2024-09-16T16:52:13.569550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'866","reported_seq":890,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.636131+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:13.636131+0000","last_peered":"2024-09-16T16:52:13.636131+0000","last_clean":"2024-09-16T16:52:13.636131+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:13.636131+0000","last_undegraded":"2024-09-16T16:52:13.636131+0000","last_fullsized":"2024-09-16T16:52:13.636131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":866,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'784","reported_seq":808,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.527840+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:13.527840+0000","last_peered":"2024-09-16T16:52:13.527840+0000","last_clean":"2024-09-16T16:52:13.527840+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:13.527840+0000","last_undegraded":"2024-09-16T16:52:13.527840+0000","last_fullsized":"2024-09-16T16:52:13.527840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20578304,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'875","reported_seq":899,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.481757+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:13.481757+0000","last_peered":"2024-09-16T16:52:13.481757+0000","last_clean":"2024-09-16T16:52:13.481757+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:13.481757+0000","last_undegraded":"2024-09-16T16:52:13.481757+0000","last_fullsized":"2024-09-16T16:52:13.481757+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":875,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'841","reported_seq":865,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.699020+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:13.699020+0000","last_peered":"2024-09-16T16:52:13.699020+0000","last_clean":"2024-09-16T16:52:13.699020+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:13.699020+0000","last_undegraded":"2024-09-16T16:52:13.699020+0000","last_fullsized":"2024-09-16T16:52:13.699020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'850","reported_seq":874,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.710580+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:13.710580+0000","last_peered":"2024-09-16T16:52:13.710580+0000","last_clean":"2024-09-16T16:52:13.710580+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:13.710580+0000","last_undegraded":"2024-09-16T16:52:13.710580+0000","last_fullsized":"2024-09-16T16:52:13.710580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'908","reported_seq":932,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.751826+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:13.751826+0000","last_peered":"2024-09-16T16:52:13.751826+0000","last_clean":"2024-09-16T16:52:13.751826+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:13.751826+0000","last_undegraded":"2024-09-16T16:52:13.751826+0000","last_fullsized":"2024-09-16T16:52:13.751826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'891","reported_seq":915,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.716271+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:13.716271+0000","last_peered":"2024-09-16T16:52:13.716271+0000","last_clean":"2024-09-16T16:52:13.716271+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:13.716271+0000","last_undegraded":"2024-09-16T16:52:13.716271+0000","last_fullsized":"2024-09-16T16:52:13.716271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'842","reported_seq":866,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.681705+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:13.681705+0000","last_peered":"2024-09-16T16:52:13.681705+0000","last_clean":"2024-09-16T16:52:13.681705+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:13.681705+0000","last_undegraded":"2024-09-16T16:52:13.681705+0000","last_fullsized":"2024-09-16T16:52:13.681705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'877","reported_seq":901,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.533200+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:13.533200+0000","last_peered":"2024-09-16T16:52:13.533200+0000","last_clean":"2024-09-16T16:52:13.533200+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:13.533200+0000","last_undegraded":"2024-09-16T16:52:13.533200+0000","last_fullsized":"2024-09-16T16:52:13.533200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'883","reported_seq":907,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:13.146783+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:13.146783+0000","last_peered":"2024-09-16T16:52:13.146783+0000","last_clean":"2024-09-16T16:52:13.146783+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:13.146783+0000","last_undegraded":"2024-09-16T16:52:13.146783+0000","last_fullsized":"2024-09-16T16:52:13.146783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":361431064,"num_objects":5516,"num_object_clones":0,"num_object_copies":16548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13846,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211996483584,"internally_reserved":0,"allocated":2215010304,"data_stored":2215010304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13846,"ondisk_log_size":13846,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211996217344,"internally_reserved":0,"allocated":2215276544,"data_stored":2215276544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":598024,"kb_used_data":598024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51699704,"statfs":{"total":53552873472,"available":52940496896,"internally_reserved":0,"allocated":612376576,"data_stored":612376576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":452236,"kb_used_data":452236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51845492,"statfs":{"total":53552873472,"available":53089783808,"internally_reserved":0,"allocated":463089664,"data_stored":463089664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":596560,"kb_used_data":596560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51701168,"statfs":{"total":53552873472,"available":52941996032,"internally_reserved":0,"allocated":610877440,"data_stored":610877440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":544884,"kb_used_data":544884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51752844,"statfs":{"total":53552873472,"available":52994912256,"internally_reserved":0,"allocated":557961216,"data_stored":557961216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52999847936,"internally_reserved":0,"allocated":553025536,"data_stored":553025536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52950773760,"internally_reserved":0,"allocated":602099712,"data_stored":602099712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53095948288,"internally_reserved":0,"allocated":456925184,"data_stored":456925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":52999983104,"internally_reserved":0,"allocated":552890368,"data_stored":552890368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":52950904832,"internally_reserved":0,"allocated":601968640,"data_stored":601968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53095948288,"internally_reserved":0,"allocated":456925184,"data_stored":456925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":52949647360,"internally_reserved":0,"allocated":603226112,"data_stored":603226112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:39.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:39.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:39.695+0000 7f645a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:39.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:39.702+0000 7f645a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:42.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:42.475+0000 7f7b81f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:42.486+0000 7f7b81f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:43.840 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:43.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:52:43.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:43.979+0000 7f9067591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:43.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:43.992+0000 7f9067591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.702 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:52:44.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:52:44.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:44.851+0000 7ffa9f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:44.864+0000 7ffa9f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:45.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:45.106+0000 7f45ab86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:45.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:45.113+0000 7f45ab86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:45.703 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:52:45.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:52:45.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:45.859+0000 7fa624511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:45.872+0000 7fa624511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:46.709 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:52:46.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:52:46.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:46.895+0000 7fd54d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:46.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:46.909+0000 7fd54d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:47.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:47.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:47.528+0000 7fd2bab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:47.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:47.535+0000 7fd2bab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:47.719 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:52:47.738 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:52:47.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:47.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:47.875+0000 7f12a7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:47.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:47.887+0000 7f12a7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:48.133 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:48.148 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-16T16:52:47.832081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63635456,"num_objects":-971,"num_object_clones":0,"num_object_copies":-2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":971,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000769"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:48.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:48.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:48.335+0000 7fd1e1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:48.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:48.345+0000 7fd1e1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:48.649 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:48.650 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:48.666 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-16T16:52:47.832081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63635456,"num_objects":-971,"num_object_clones":0,"num_object_copies":-2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":971,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000769"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:48.668 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:52:48.668 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:48.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:48.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:48.811+0000 7f8bf1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:48.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:48.821+0000 7f8bf1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:49.109 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:49.109 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:49.129 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-16T16:52:47.832081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63635456,"num_objects":-971,"num_object_clones":0,"num_object_copies":-2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":971,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000769"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:49.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:50.005+0000 7f8a26391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:50.011+0000 7f8a26391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:52.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:52.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:52.562+0000 7f7816791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:52.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:52.570+0000 7f7816791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:54.131 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:54.131 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:54.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:54.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:54.292+0000 7f712cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:54.304+0000 7f712cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:52:54.653 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:52:54.675 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-09-16T16:52:53.833310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001583"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:55.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:55.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:55.180+0000 7f2559e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:55.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:55.187+0000 7f2559e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:57.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:57.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:57.738+0000 7f4701711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:57.746+0000 7f4701711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:59.677 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:59.678 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:59.678 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:59.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:59.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:59.848+0000 7f25c84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:59.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:52:59.866+0000 7f25c84fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:00.004 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:00.005 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:00.005 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:00.005 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:00.005 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:00.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:00.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:00.010 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:00.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.164+0000 7f8d4dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.183+0000 7f8d4dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.249+0000 7ff95a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.259+0000 7ff95a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.334 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:00.334 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:00.334 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:00.334 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:00.335 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:00.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:00.339 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:00.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:00.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.506+0000 7fd24a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.524+0000 7fd24a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.611 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:00.611 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:00.611 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:00.612 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:00.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:00.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:00.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:00.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.761+0000 7f4f06cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:00.773+0000 7f4f06cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:00.819 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:00.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:00.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:02.645 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:02.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:02.807+0000 7f63e4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:02.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:02.815+0000 7f63e4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:05.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:05.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:05.420+0000 7fa41d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:05.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:05.427+0000 7fa41d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:05.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:05.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:05.824 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:05.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:05.985+0000 7fdbed6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:06.001+0000 7fdbed6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:06.264 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:06.283 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-16T16:53:05.836045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002735"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:07.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:07.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:07.935+0000 7fa444ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:07.943+0000 7fa444ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:10.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:10.418+0000 7f4c5eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:10.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:10.425+0000 7f4c5eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:10.589 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 9680 objects 2024-09-16T16:53:10.589 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :88.7597 2024-09-16T16:53:11.285 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:11.285 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:11.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:11.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:11.393+0000 7f68d9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:11.401+0000 7f68d9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:11.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:11.586 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:11.600 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-16T16:53:09.836847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":164364875,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16943,"num_write_kb":620629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16917,"ondisk_log_size":16917,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1014564,"kb_used_data":1014564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208176348,"statfs":{"total":214211493888,"available":213172580352,"internally_reserved":0,"allocated":1038913536,"data_stored":1038913536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002565"},"pg_stats":[{"pgid":"4.f","version":"39'1012","reported_seq":1036,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.394523+0000","last_change":"2024-09-16T16:50:09.987809+0000","last_active":"2024-09-16T16:52:43.394523+0000","last_peered":"2024-09-16T16:52:43.394523+0000","last_clean":"2024-09-16T16:52:43.394523+0000","last_became_active":"2024-09-16T16:50:09.980427+0000","last_became_peered":"2024-09-16T16:50:09.980427+0000","last_unstale":"2024-09-16T16:52:43.394523+0000","last_undegraded":"2024-09-16T16:52:43.394523+0000","last_fullsized":"2024-09-16T16:52:43.394523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"39'1101","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.742486+0000","last_change":"2024-09-16T16:50:09.859619+0000","last_active":"2024-09-16T16:52:43.742486+0000","last_peered":"2024-09-16T16:52:43.742486+0000","last_clean":"2024-09-16T16:52:43.742486+0000","last_became_active":"2024-09-16T16:50:09.853186+0000","last_became_peered":"2024-09-16T16:50:09.853186+0000","last_unstale":"2024-09-16T16:52:43.742486+0000","last_undegraded":"2024-09-16T16:52:43.742486+0000","last_fullsized":"2024-09-16T16:52:43.742486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"39'1074","reported_seq":1099,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.221366+0000","last_change":"2024-09-16T16:50:09.900326+0000","last_active":"2024-09-16T16:52:43.221366+0000","last_peered":"2024-09-16T16:52:43.221366+0000","last_clean":"2024-09-16T16:52:43.221366+0000","last_became_active":"2024-09-16T16:50:09.880830+0000","last_became_peered":"2024-09-16T16:50:09.880830+0000","last_unstale":"2024-09-16T16:52:43.221366+0000","last_undegraded":"2024-09-16T16:52:43.221366+0000","last_fullsized":"2024-09-16T16:52:43.221366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764888,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1074,"num_write_kb":39105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"39'1094","reported_seq":1118,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.686583+0000","last_change":"2024-09-16T16:50:09.951817+0000","last_active":"2024-09-16T16:52:43.686583+0000","last_peered":"2024-09-16T16:52:43.686583+0000","last_clean":"2024-09-16T16:52:43.686583+0000","last_became_active":"2024-09-16T16:50:09.944720+0000","last_became_peered":"2024-09-16T16:50:09.944720+0000","last_unstale":"2024-09-16T16:52:43.686583+0000","last_undegraded":"2024-09-16T16:52:43.686583+0000","last_fullsized":"2024-09-16T16:52:43.686583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"39'1029","reported_seq":1053,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.558857+0000","last_change":"2024-09-16T16:50:09.916594+0000","last_active":"2024-09-16T16:52:43.558857+0000","last_peered":"2024-09-16T16:52:43.558857+0000","last_clean":"2024-09-16T16:52:43.558857+0000","last_became_active":"2024-09-16T16:50:09.901284+0000","last_became_peered":"2024-09-16T16:50:09.901284+0000","last_unstale":"2024-09-16T16:52:43.558857+0000","last_undegraded":"2024-09-16T16:52:43.558857+0000","last_fullsized":"2024-09-16T16:52:43.558857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.740071+0000","last_change":"2024-09-16T16:50:09.909914+0000","last_active":"2024-09-16T16:52:43.740071+0000","last_peered":"2024-09-16T16:52:43.740071+0000","last_clean":"2024-09-16T16:52:43.740071+0000","last_became_active":"2024-09-16T16:50:09.899977+0000","last_became_peered":"2024-09-16T16:50:09.899977+0000","last_unstale":"2024-09-16T16:52:43.740071+0000","last_undegraded":"2024-09-16T16:52:43.740071+0000","last_fullsized":"2024-09-16T16:52:43.740071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"39'1058","reported_seq":1082,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.137551+0000","last_change":"2024-09-16T16:50:09.909880+0000","last_active":"2024-09-16T16:52:43.137551+0000","last_peered":"2024-09-16T16:52:43.137551+0000","last_clean":"2024-09-16T16:52:43.137551+0000","last_became_active":"2024-09-16T16:50:09.884830+0000","last_became_peered":"2024-09-16T16:50:09.884830+0000","last_unstale":"2024-09-16T16:52:43.137551+0000","last_undegraded":"2024-09-16T16:52:43.137551+0000","last_fullsized":"2024-09-16T16:52:43.137551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"39'942","reported_seq":966,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.280421+0000","last_change":"2024-09-16T16:50:09.864825+0000","last_active":"2024-09-16T16:52:42.280421+0000","last_peered":"2024-09-16T16:52:42.280421+0000","last_clean":"2024-09-16T16:52:42.280421+0000","last_became_active":"2024-09-16T16:50:09.853628+0000","last_became_peered":"2024-09-16T16:50:09.853628+0000","last_unstale":"2024-09-16T16:52:42.280421+0000","last_undegraded":"2024-09-16T16:52:42.280421+0000","last_fullsized":"2024-09-16T16:52:42.280421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"39'1086","reported_seq":1110,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.682335+0000","last_change":"2024-09-16T16:50:09.877525+0000","last_active":"2024-09-16T16:52:42.682335+0000","last_peered":"2024-09-16T16:52:42.682335+0000","last_clean":"2024-09-16T16:52:42.682335+0000","last_became_active":"2024-09-16T16:50:09.858468+0000","last_became_peered":"2024-09-16T16:50:09.858468+0000","last_unstale":"2024-09-16T16:52:42.682335+0000","last_undegraded":"2024-09-16T16:52:42.682335+0000","last_fullsized":"2024-09-16T16:52:42.682335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1086,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":157,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.771226+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:51:16.771226+0000","last_peered":"2024-09-16T16:51:16.771226+0000","last_clean":"2024-09-16T16:51:16.771226+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:51:16.771226+0000","last_undegraded":"2024-09-16T16:51:16.771226+0000","last_fullsized":"2024-09-16T16:51:16.771226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.870582+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:51:16.870582+0000","last_peered":"2024-09-16T16:51:16.870582+0000","last_clean":"2024-09-16T16:51:16.870582+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:51:16.870582+0000","last_undegraded":"2024-09-16T16:51:16.870582+0000","last_fullsized":"2024-09-16T16:51:16.870582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"39'1015","reported_seq":1039,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.489366+0000","last_change":"2024-09-16T16:50:09.855912+0000","last_active":"2024-09-16T16:52:43.489366+0000","last_peered":"2024-09-16T16:52:43.489366+0000","last_clean":"2024-09-16T16:52:43.489366+0000","last_became_active":"2024-09-16T16:50:09.801439+0000","last_became_peered":"2024-09-16T16:50:09.801439+0000","last_unstale":"2024-09-16T16:52:43.489366+0000","last_undegraded":"2024-09-16T16:52:43.489366+0000","last_fullsized":"2024-09-16T16:52:43.489366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.963955+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:51:16.963955+0000","last_peered":"2024-09-16T16:51:16.963955+0000","last_clean":"2024-09-16T16:51:16.963955+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:51:16.963955+0000","last_undegraded":"2024-09-16T16:51:16.963955+0000","last_fullsized":"2024-09-16T16:51:16.963955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"39'1047","reported_seq":1071,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.781853+0000","last_change":"2024-09-16T16:50:09.848536+0000","last_active":"2024-09-16T16:52:43.781853+0000","last_peered":"2024-09-16T16:52:43.781853+0000","last_clean":"2024-09-16T16:52:43.781853+0000","last_became_active":"2024-09-16T16:50:09.836112+0000","last_became_peered":"2024-09-16T16:50:09.836112+0000","last_unstale":"2024-09-16T16:52:43.781853+0000","last_undegraded":"2024-09-16T16:52:43.781853+0000","last_fullsized":"2024-09-16T16:52:43.781853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.865891+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:51:16.865891+0000","last_peered":"2024-09-16T16:51:16.865891+0000","last_clean":"2024-09-16T16:51:16.865891+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:51:16.865891+0000","last_undegraded":"2024-09-16T16:51:16.865891+0000","last_fullsized":"2024-09-16T16:51:16.865891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"39'1098","reported_seq":1122,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.783164+0000","last_change":"2024-09-16T16:50:09.928229+0000","last_active":"2024-09-16T16:52:43.783164+0000","last_peered":"2024-09-16T16:52:43.783164+0000","last_clean":"2024-09-16T16:52:43.783164+0000","last_became_active":"2024-09-16T16:50:09.918198+0000","last_became_peered":"2024-09-16T16:50:09.918198+0000","last_unstale":"2024-09-16T16:52:43.783164+0000","last_undegraded":"2024-09-16T16:52:43.783164+0000","last_fullsized":"2024-09-16T16:52:43.783164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1098,"log_dups_size":0,"ondisk_log_size":1098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1098,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.966629+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:51:16.966629+0000","last_peered":"2024-09-16T16:51:16.966629+0000","last_clean":"2024-09-16T16:51:16.966629+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:51:16.966629+0000","last_undegraded":"2024-09-16T16:51:16.966629+0000","last_fullsized":"2024-09-16T16:51:16.966629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"39'1114","reported_seq":1138,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.116062+0000","last_change":"2024-09-16T16:50:09.826152+0000","last_active":"2024-09-16T16:52:43.116062+0000","last_peered":"2024-09-16T16:52:43.116062+0000","last_clean":"2024-09-16T16:52:43.116062+0000","last_became_active":"2024-09-16T16:50:09.816520+0000","last_became_peered":"2024-09-16T16:50:09.816520+0000","last_unstale":"2024-09-16T16:52:43.116062+0000","last_undegraded":"2024-09-16T16:52:43.116062+0000","last_fullsized":"2024-09-16T16:52:43.116062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.839217+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:51:16.839217+0000","last_peered":"2024-09-16T16:51:16.839217+0000","last_clean":"2024-09-16T16:51:16.839217+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:51:16.839217+0000","last_undegraded":"2024-09-16T16:51:16.839217+0000","last_fullsized":"2024-09-16T16:51:16.839217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"39'1017","reported_seq":1041,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:42.969835+0000","last_change":"2024-09-16T16:50:09.861605+0000","last_active":"2024-09-16T16:52:42.969835+0000","last_peered":"2024-09-16T16:52:42.969835+0000","last_clean":"2024-09-16T16:52:42.969835+0000","last_became_active":"2024-09-16T16:50:09.847704+0000","last_became_peered":"2024-09-16T16:50:09.847704+0000","last_unstale":"2024-09-16T16:52:42.969835+0000","last_undegraded":"2024-09-16T16:52:42.969835+0000","last_fullsized":"2024-09-16T16:52:42.969835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":37440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.775904+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:51:16.775904+0000","last_peered":"2024-09-16T16:51:16.775904+0000","last_clean":"2024-09-16T16:51:16.775904+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:51:16.775904+0000","last_undegraded":"2024-09-16T16:51:16.775904+0000","last_fullsized":"2024-09-16T16:51:16.775904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"39'1054","reported_seq":1078,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.380887+0000","last_change":"2024-09-16T16:50:09.896390+0000","last_active":"2024-09-16T16:52:43.380887+0000","last_peered":"2024-09-16T16:52:43.380887+0000","last_clean":"2024-09-16T16:52:43.380887+0000","last_became_active":"2024-09-16T16:50:09.886029+0000","last_became_peered":"2024-09-16T16:50:09.886029+0000","last_unstale":"2024-09-16T16:52:43.380887+0000","last_undegraded":"2024-09-16T16:52:43.380887+0000","last_fullsized":"2024-09-16T16:52:43.380887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":38656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.831716+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:51:16.831716+0000","last_peered":"2024-09-16T16:51:16.831716+0000","last_clean":"2024-09-16T16:51:16.831716+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:51:16.831716+0000","last_undegraded":"2024-09-16T16:51:16.831716+0000","last_fullsized":"2024-09-16T16:51:16.831716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"39'1067","reported_seq":1091,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:52:43.498810+0000","last_change":"2024-09-16T16:50:09.903484+0000","last_active":"2024-09-16T16:52:43.498810+0000","last_peered":"2024-09-16T16:52:43.498810+0000","last_clean":"2024-09-16T16:52:43.498810+0000","last_became_active":"2024-09-16T16:50:09.892829+0000","last_became_peered":"2024-09-16T16:50:09.892829+0000","last_unstale":"2024-09-16T16:52:43.498810+0000","last_undegraded":"2024-09-16T16:52:43.498810+0000","last_fullsized":"2024-09-16T16:52:43.498810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:08.692666+0000","last_clean_scrub_stamp":"2024-09-16T16:50:08.692666+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T16:51:16.868865+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:51:16.868865+0000","last_peered":"2024-09-16T16:51:16.868865+0000","last_clean":"2024-09-16T16:51:16.868865+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:51:16.868865+0000","last_undegraded":"2024-09-16T16:51:16.868865+0000","last_fullsized":"2024-09-16T16:51:16.868865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":163774488,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16862,"num_write_kb":619521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185523712,"internally_reserved":0,"allocated":1025970176,"data_stored":1025970176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16862,"ondisk_log_size":16862,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213185392640,"internally_reserved":0,"allocated":1026101248,"data_stored":1026101248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275784,"kb_used_data":275784,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52021944,"statfs":{"total":53552873472,"available":53270470656,"internally_reserved":0,"allocated":282402816,"data_stored":282402816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":207212,"kb_used_data":207212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52090516,"statfs":{"total":53552873472,"available":53340688384,"internally_reserved":0,"allocated":212185088,"data_stored":212185088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":275136,"kb_used_data":275136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52022592,"statfs":{"total":53552873472,"available":53271134208,"internally_reserved":0,"allocated":281739264,"data_stored":281739264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":256432,"kb_used_data":256432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52041296,"statfs":{"total":53552873472,"available":53290287104,"internally_reserved":0,"allocated":262586368,"data_stored":262586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53274857472,"internally_reserved":0,"allocated":278016000,"data_stored":278016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53292204032,"internally_reserved":0,"allocated":260669440,"data_stored":260669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53292335104,"internally_reserved":0,"allocated":260538368,"data_stored":260538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53274460160,"internally_reserved":0,"allocated":278413312,"data_stored":278413312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53343875072,"internally_reserved":0,"allocated":208998400,"data_stored":208998400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53274853376,"internally_reserved":0,"allocated":278020096,"data_stored":278020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:12.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:12.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:12.740+0000 7f3037591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:12.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:12.745+0000 7f3037591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.761 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-16T16:53:13.761 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-16T16:53:13.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:13.877+0000 7faa39e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:13.893+0000 7faa39e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_1' removed 2024-09-16T16:53:14.738 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:53:14.739 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:53:14.739 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-16T16:53:14.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-16T16:53:14.850 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:14.907+0000 7fd42a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:14.930+0000 7fd42a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:14.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:14.988+0000 7ffa1c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:14.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:14.998+0000 7ffa1c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:15.717 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_2' created 2024-09-16T16:53:15.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-16T16:53:15.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:15.863+0000 7f9871d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:15.884+0000 7f9871d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:16.602 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:16.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:53:16.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:16.710+0000 7f9329991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:16.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:16.719+0000 7f9329991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:16.725 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-16T16:53:17.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:17.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:17.380+0000 7f0ca4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:17.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:17.386+0000 7f0ca4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:17.728 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:53:17.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:53:17.749 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-16T16:53:17.790 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:53:17.790 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:53:17.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-16T16:53:17.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:53:17.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_43855 2024-09-16T16:53:17.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:17.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:53:17.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:17.852+0000 7fd632b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:17.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:17.869+0000 7fd632b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.729 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:53:18.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:53:18.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 97 81 5.06207 5.0625 0.0327851 0.144439 2024-09-16T16:53:18.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:18.912+0000 7fa8f34d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:18.925+0000 7fa8f34d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:19.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:19.643+0000 7f216dcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:19.652+0000 7f216dcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.734 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:53:19.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:53:19.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 181 165 5.15574 5.25 0.150059 0.172998 2024-09-16T16:53:19.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:19.869+0000 7f27ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:19.883+0000 7f27ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:20.741 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:53:20.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:53:20.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:20.853 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 274 258 5.3745 5.8125 0.345717 0.176109 2024-09-16T16:53:20.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:20.927+0000 7f83c4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:20.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:20.937+0000 7f83c4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.191 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:21.191 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:21.212 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-16T16:53:20.742318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016899"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:21.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:21.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:21.352+0000 7fac9c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:21.363+0000 7fac9c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.734 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:21.735 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:21.757 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-16T16:53:20.742318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016899"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:21.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:21.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 359 343 5.35884 5.3125 0.158246 0.178113 2024-09-16T16:53:21.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:21.887+0000 7f7786074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:21.894+0000 7f7786074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:22.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:22.041+0000 7fd28b351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:22.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:22.050+0000 7fd28b351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:22.408 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:22.408 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":405,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":36413440,"bytes_avail":214175080448,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:22.431 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:22.431 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:22.580+0000 7f7de2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:22.589+0000 7f7de2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:22.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 446 430 5.37447 5.4375 0.0660618 0.180388 2024-09-16T16:53:22.876 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:22.876 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:22.894 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-16T16:53:21.839868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.110919"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:23.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 559 543 5.65568 7.0625 0.282118 0.173093 2024-09-16T16:53:24.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:24.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:24.443+0000 7f351a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:24.450+0000 7f351a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:24.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 659 643 5.7405 6.25 0.165578 0.170133 2024-09-16T16:53:25.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 721 705 5.50726 3.875 0.0454633 0.176295 2024-09-16T16:53:25.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:26.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.021+0000 7fec8387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.032+0000 7fec8387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.288 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:26.288 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:26.307 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-16T16:53:25.840690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.110887"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:26.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:26.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.457+0000 7f1bce246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.466+0000 7f1bce246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:26.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.768+0000 7fafb2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.776+0000 7fafb2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.802 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:26.802 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":410,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":36413440,"bytes_avail":214175080448,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:26.818 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:26.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:26.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 816 800 5.55501 5.9375 0.0871769 0.176951 2024-09-16T16:53:26.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.973+0000 7f9ebe49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:26.983+0000 7f9ebe49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:27.251 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:27.252 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:27.266 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-16T16:53:25.840690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.110887"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:27.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 904 888 5.54945 5.5 0.0659819 0.176518 2024-09-16T16:53:28.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 1016 1000 5.68126 7 0.141779 0.174649 2024-09-16T16:53:29.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:29.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:29.216+0000 7f561d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:29.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:29.222+0000 7f561d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:29.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1112 1096 5.70778 6 0.048846 0.172468 2024-09-16T16:53:30.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:30.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:30.421+0000 7f25fe8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:30.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:30.432+0000 7f25fe8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:30.777 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:30.778 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:30.797 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-16T16:53:29.841568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002148"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:30.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:30.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1219 1203 5.78308 6.6875 0.0526001 0.1715 2024-09-16T16:53:30.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:30.937+0000 7f3b68f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:30.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:30.946+0000 7f3b68f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.456 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:31.456 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":414,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":36413440,"bytes_avail":214175080448,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:31.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:31.482 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:31.482 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:31.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:31.627+0000 7f0af7074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:31.637+0000 7f0af7074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:31.697+0000 7f511d4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:31.711+0000 7f511d4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.854 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1333 1317 5.87889 7.125 0.0482729 0.168576 2024-09-16T16:53:32.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:32.084 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:32.104 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-16T16:53:31.841915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.099597"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:32.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1446 1430 5.95776 7.0625 0.305354 0.16697 2024-09-16T16:53:33.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1554 1538 6.00722 6.75 0.154439 0.165409 2024-09-16T16:53:33.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:34.039+0000 7f6a68591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:34.049+0000 7f6a68591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:34.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1655 1639 6.02515 6.3125 0.096708 0.165085 2024-09-16T16:53:35.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:35.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:35.232+0000 7f967a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:35.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:35.242+0000 7f967a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:35.607 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:35.624 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-16T16:53:33.842352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002483"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:35.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:35.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:35.760+0000 7fb884b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:35.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:35.769+0000 7fb884b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:35.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1756 1740 6.04108 6.3125 0.176046 0.164363 2024-09-16T16:53:36.105 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:36.105 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":419,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":36413440,"bytes_avail":214175080448,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:36.128 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:36.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:36.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:36.271+0000 7f2594591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:36.280+0000 7f2594591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:36.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:36.532+0000 7fa1bb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:36.539+0000 7fa1bb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.650 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:36.650 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:36.667 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-16T16:53:35.842809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002486"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:36.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1850 1834 6.03231 5.875 0.118894 0.164611 2024-09-16T16:53:37.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:53:37.855765+0000 min lat: 0.0199272 max lat: 0.999889 avg lat: 0.163224 2024-09-16T16:53:37.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:37.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 1969 1953 6.10253 7.4375 0.310892 0.163224 2024-09-16T16:53:38.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:38.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 2070 2054 6.11249 6.3125 0.0675319 0.162092 2024-09-16T16:53:38.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:38.951+0000 7f00bbd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:38.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:38.958+0000 7f00bbd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:39.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:39.802+0000 7f6f2f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:39.815+0000 7f6f2f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:39.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2162 2146 6.096 5.75 0.515027 0.162919 2024-09-16T16:53:40.098 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:40.111 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T16:53:39.843702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002573"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:40.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:40.242+0000 7fda7bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:40.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:40.250+0000 7fda7bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:40.774 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:40.774 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":424,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":36413440,"bytes_avail":214175080448,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:40.794 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:40.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:40.855 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2253 2237 6.07822 5.6875 0.113374 0.16359 2024-09-16T16:53:40.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:40.965+0000 7fd7c9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:40.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:40.975+0000 7fd7c9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:41.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:41.341 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:41.342 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:41.368 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T16:53:39.843702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":35560,"kb_used_data":35560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209155352,"statfs":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002573"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.809020+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:52:47.809020+0000","last_peered":"2024-09-16T16:52:47.809020+0000","last_clean":"2024-09-16T16:52:47.809020+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:52:47.809020+0000","last_undegraded":"2024-09-16T16:52:47.809020+0000","last_fullsized":"2024-09-16T16:52:47.809020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.109384+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:52:48.109384+0000","last_peered":"2024-09-16T16:52:48.109384+0000","last_clean":"2024-09-16T16:52:48.109384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:52:48.109384+0000","last_undegraded":"2024-09-16T16:52:48.109384+0000","last_fullsized":"2024-09-16T16:52:48.109384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.804071+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:52:47.804071+0000","last_peered":"2024-09-16T16:52:47.804071+0000","last_clean":"2024-09-16T16:52:47.804071+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:52:47.804071+0000","last_undegraded":"2024-09-16T16:52:47.804071+0000","last_fullsized":"2024-09-16T16:52:47.804071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:48.113318+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:52:48.113318+0000","last_peered":"2024-09-16T16:52:48.113318+0000","last_clean":"2024-09-16T16:52:48.113318+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:52:48.113318+0000","last_undegraded":"2024-09-16T16:52:48.113318+0000","last_fullsized":"2024-09-16T16:52:48.113318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.807741+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:52:47.807741+0000","last_peered":"2024-09-16T16:52:47.807741+0000","last_clean":"2024-09-16T16:52:47.807741+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:52:47.807741+0000","last_undegraded":"2024-09-16T16:52:47.807741+0000","last_fullsized":"2024-09-16T16:52:47.807741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214175080448,"internally_reserved":0,"allocated":36413440,"data_stored":36413440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8940,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288788,"statfs":{"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9108,"kb_used_data":9108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288620,"statfs":{"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543546880,"internally_reserved":0,"allocated":9326592,"data_stored":9326592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543718912,"internally_reserved":0,"allocated":9154560,"data_stored":9154560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:41.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:41.395+0000 7f6597b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:41.402+0000 7f6597b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:41.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 2324 2308 6.00984 4.4375 0.0271371 0.164899 2024-09-16T16:53:42.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 2430 2414 6.03442 6.625 0.112136 0.16523 2024-09-16T16:53:43.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:43.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:43.770+0000 7fc023a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:43.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:43.781+0000 7fc023a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:43.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2545 2529 6.07874 7.1875 0.0695353 0.163633 2024-09-16T16:53:44.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:44.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:44.538+0000 7f0071151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:44.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:44.549+0000 7f0071151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:44.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2649 2633 6.09432 6.5 0.168508 0.163606 2024-09-16T16:53:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:44.861 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:44.885 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-16T16:53:43.844494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80413235,"num_objects":1222,"num_object_clones":0,"num_object_copies":3666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1299,"num_write_kb":79060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1273,"ondisk_log_size":1273,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":476124,"kb_used_data":476124,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208714788,"statfs":{"total":214211493888,"available":213723942912,"internally_reserved":0,"allocated":487550976,"data_stored":487550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":79822848,"num_objects":1218,"num_object_clones":0,"num_object_copies":3654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":77952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002579"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.713613+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:53:43.713613+0000","last_peered":"2024-09-16T16:53:43.713613+0000","last_clean":"2024-09-16T16:53:43.713613+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:53:43.713613+0000","last_undegraded":"2024-09-16T16:53:43.713613+0000","last_fullsized":"2024-09-16T16:53:43.713613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.504621+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:53:43.504621+0000","last_peered":"2024-09-16T16:53:43.504621+0000","last_clean":"2024-09-16T16:53:43.504621+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:53:43.504621+0000","last_undegraded":"2024-09-16T16:53:43.504621+0000","last_fullsized":"2024-09-16T16:53:43.504621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"50'153","reported_seq":174,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.624499+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:53:43.624499+0000","last_peered":"2024-09-16T16:53:43.624499+0000","last_clean":"2024-09-16T16:53:43.624499+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:53:43.624499+0000","last_undegraded":"2024-09-16T16:53:43.624499+0000","last_fullsized":"2024-09-16T16:53:43.624499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"50'152","reported_seq":173,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.669114+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:53:43.669114+0000","last_peered":"2024-09-16T16:53:43.669114+0000","last_clean":"2024-09-16T16:53:43.669114+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:53:43.669114+0000","last_undegraded":"2024-09-16T16:53:43.669114+0000","last_fullsized":"2024-09-16T16:53:43.669114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'146","reported_seq":167,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.351615+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:53:43.351615+0000","last_peered":"2024-09-16T16:53:43.351615+0000","last_clean":"2024-09-16T16:53:43.351615+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:53:43.351615+0000","last_undegraded":"2024-09-16T16:53:43.351615+0000","last_fullsized":"2024-09-16T16:53:43.351615+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.781704+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:52:47.781704+0000","last_peered":"2024-09-16T16:52:47.781704+0000","last_clean":"2024-09-16T16:52:47.781704+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:52:47.781704+0000","last_undegraded":"2024-09-16T16:52:47.781704+0000","last_fullsized":"2024-09-16T16:52:47.781704+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'158","reported_seq":179,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.707756+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:53:43.707756+0000","last_peered":"2024-09-16T16:53:43.707756+0000","last_clean":"2024-09-16T16:53:43.707756+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:53:43.707756+0000","last_undegraded":"2024-09-16T16:53:43.707756+0000","last_fullsized":"2024-09-16T16:53:43.707756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763793+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:52:47.763793+0000","last_peered":"2024-09-16T16:52:47.763793+0000","last_clean":"2024-09-16T16:52:47.763793+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:52:47.763793+0000","last_undegraded":"2024-09-16T16:52:47.763793+0000","last_fullsized":"2024-09-16T16:52:47.763793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'144","reported_seq":165,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.435418+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:53:43.435418+0000","last_peered":"2024-09-16T16:53:43.435418+0000","last_clean":"2024-09-16T16:53:43.435418+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:53:43.435418+0000","last_undegraded":"2024-09-16T16:53:43.435418+0000","last_fullsized":"2024-09-16T16:53:43.435418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.790124+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:52:47.790124+0000","last_peered":"2024-09-16T16:52:47.790124+0000","last_clean":"2024-09-16T16:52:47.790124+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:52:47.790124+0000","last_undegraded":"2024-09-16T16:52:47.790124+0000","last_fullsized":"2024-09-16T16:52:47.790124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:53:15.715753+0000","last_change":"2024-09-16T16:53:15.715753+0000","last_active":"2024-09-16T16:53:15.715753+0000","last_peered":"2024-09-16T16:53:15.715753+0000","last_clean":"2024-09-16T16:53:15.715753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:53:15.715753+0000","last_undegraded":"2024-09-16T16:53:15.715753+0000","last_fullsized":"2024-09-16T16:53:15.715753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T16:52:47.763644+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:52:47.763644+0000","last_peered":"2024-09-16T16:52:47.763644+0000","last_clean":"2024-09-16T16:52:47.763644+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:52:47.763644+0000","last_undegraded":"2024-09-16T16:52:47.763644+0000","last_fullsized":"2024-09-16T16:52:47.763644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'139","reported_seq":160,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.570208+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:53:43.570208+0000","last_peered":"2024-09-16T16:53:43.570208+0000","last_clean":"2024-09-16T16:53:43.570208+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:53:43.570208+0000","last_undegraded":"2024-09-16T16:53:43.570208+0000","last_fullsized":"2024-09-16T16:53:43.570208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":79822848,"num_objects":1218,"num_object_clones":0,"num_object_copies":3654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":77952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":107105746944,"available":106627059712,"internally_reserved":0,"allocated":478687232,"data_stored":478687232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1218,"ondisk_log_size":1218,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213714874368,"internally_reserved":0,"allocated":496619520,"data_stored":496619520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9520,"kb_used_data":9520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288208,"statfs":{"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7992,"kb_used_data":7992,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289736,"statfs":{"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":193856,"kb_used_data":193856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52103872,"statfs":{"total":53552873472,"available":53354364928,"internally_reserved":0,"allocated":198508544,"data_stored":198508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":264756,"kb_used_data":264756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52032972,"statfs":{"total":53552873472,"available":53281763328,"internally_reserved":0,"allocated":271110144,"data_stored":271110144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544689664,"internally_reserved":0,"allocated":8183808,"data_stored":8183808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543124992,"internally_reserved":0,"allocated":9748480,"data_stored":9748480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:44.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:53:45.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:45.061+0000 7f8a13911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:45.070+0000 7f8a13911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:45.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:45.589 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":428,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":50,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505203,"num_in_osds":4,"osd_in_since":1726505198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":17},{"state_name":"unknown","count":8}],"num_pgs":25,"num_pools":3,"num_objects":1222,"data_bytes":80413235,"bytes_used":487550976,"bytes_avail":213723942912,"bytes_total":214211493888,"unknown_pgs_ratio":0.31999999284744263,"write_bytes_sec":6650474,"read_op_per_sec":0,"write_op_per_sec":101},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:36:653827+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:43.767854+0000","services":{}},"progress_events":{}} 2024-09-16T16:53:45.611 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:53:45.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:45.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:45.738+0000 7fef57991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:45.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:45.753+0000 7fef57991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:45.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2752 2736 6.10655 6.4375 0.092247 0.163295 2024-09-16T16:53:46.013 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:46.014 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:46.030 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-16T16:53:45.845017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167182899,"num_objects":2546,"num_object_clones":0,"num_object_copies":7638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2623,"num_write_kb":163796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2597,"ondisk_log_size":2597,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":970892,"kb_used_data":970892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208220020,"statfs":{"total":214211493888,"available":213217300480,"internally_reserved":0,"allocated":994193408,"data_stored":994193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2542,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002665"},"pg_stats":[{"pgid":"5.f","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.593339+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:53:43.593339+0000","last_peered":"2024-09-16T16:53:43.593339+0000","last_clean":"2024-09-16T16:53:43.593339+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:53:43.593339+0000","last_undegraded":"2024-09-16T16:53:43.593339+0000","last_fullsized":"2024-09-16T16:53:43.593339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.713613+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:53:43.713613+0000","last_peered":"2024-09-16T16:53:43.713613+0000","last_clean":"2024-09-16T16:53:43.713613+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:53:43.713613+0000","last_undegraded":"2024-09-16T16:53:43.713613+0000","last_fullsized":"2024-09-16T16:53:43.713613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.504621+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:53:43.504621+0000","last_peered":"2024-09-16T16:53:43.504621+0000","last_clean":"2024-09-16T16:53:43.504621+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:53:43.504621+0000","last_undegraded":"2024-09-16T16:53:43.504621+0000","last_fullsized":"2024-09-16T16:53:43.504621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.443166+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:53:43.443166+0000","last_peered":"2024-09-16T16:53:43.443166+0000","last_clean":"2024-09-16T16:53:43.443166+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:53:43.443166+0000","last_undegraded":"2024-09-16T16:53:43.443166+0000","last_fullsized":"2024-09-16T16:53:43.443166+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'153","reported_seq":174,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.624499+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:53:43.624499+0000","last_peered":"2024-09-16T16:53:43.624499+0000","last_clean":"2024-09-16T16:53:43.624499+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:53:43.624499+0000","last_undegraded":"2024-09-16T16:53:43.624499+0000","last_fullsized":"2024-09-16T16:53:43.624499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.498085+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:53:43.498085+0000","last_peered":"2024-09-16T16:53:43.498085+0000","last_clean":"2024-09-16T16:53:43.498085+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:53:43.498085+0000","last_undegraded":"2024-09-16T16:53:43.498085+0000","last_fullsized":"2024-09-16T16:53:43.498085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'152","reported_seq":173,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.669114+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:53:43.669114+0000","last_peered":"2024-09-16T16:53:43.669114+0000","last_clean":"2024-09-16T16:53:43.669114+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:53:43.669114+0000","last_undegraded":"2024-09-16T16:53:43.669114+0000","last_fullsized":"2024-09-16T16:53:43.669114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'146","reported_seq":167,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.351615+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:53:43.351615+0000","last_peered":"2024-09-16T16:53:43.351615+0000","last_clean":"2024-09-16T16:53:43.351615+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:53:43.351615+0000","last_undegraded":"2024-09-16T16:53:43.351615+0000","last_fullsized":"2024-09-16T16:53:43.351615+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'173","reported_seq":194,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.486439+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:53:43.486439+0000","last_peered":"2024-09-16T16:53:43.486439+0000","last_clean":"2024-09-16T16:53:43.486439+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:53:43.486439+0000","last_undegraded":"2024-09-16T16:53:43.486439+0000","last_fullsized":"2024-09-16T16:53:43.486439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'158","reported_seq":179,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.707756+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:53:43.707756+0000","last_peered":"2024-09-16T16:53:43.707756+0000","last_clean":"2024-09-16T16:53:43.707756+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:53:43.707756+0000","last_undegraded":"2024-09-16T16:53:43.707756+0000","last_fullsized":"2024-09-16T16:53:43.707756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'187","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.519178+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:53:43.519178+0000","last_peered":"2024-09-16T16:53:43.519178+0000","last_clean":"2024-09-16T16:53:43.519178+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:53:43.519178+0000","last_undegraded":"2024-09-16T16:53:43.519178+0000","last_fullsized":"2024-09-16T16:53:43.519178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.656317+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:53:43.656317+0000","last_peered":"2024-09-16T16:53:43.656317+0000","last_clean":"2024-09-16T16:53:43.656317+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:53:43.656317+0000","last_undegraded":"2024-09-16T16:53:43.656317+0000","last_fullsized":"2024-09-16T16:53:43.656317+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.556936+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:53:43.556936+0000","last_peered":"2024-09-16T16:53:43.556936+0000","last_clean":"2024-09-16T16:53:43.556936+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:53:43.556936+0000","last_undegraded":"2024-09-16T16:53:43.556936+0000","last_fullsized":"2024-09-16T16:53:43.556936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'144","reported_seq":165,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.435418+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:53:43.435418+0000","last_peered":"2024-09-16T16:53:43.435418+0000","last_clean":"2024-09-16T16:53:43.435418+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:53:43.435418+0000","last_undegraded":"2024-09-16T16:53:43.435418+0000","last_fullsized":"2024-09-16T16:53:43.435418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'163","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.662791+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:53:43.662791+0000","last_peered":"2024-09-16T16:53:43.662791+0000","last_clean":"2024-09-16T16:53:43.662791+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:53:43.662791+0000","last_undegraded":"2024-09-16T16:53:43.662791+0000","last_fullsized":"2024-09-16T16:53:43.662791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'139","reported_seq":160,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.570208+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:53:43.570208+0000","last_peered":"2024-09-16T16:53:43.570208+0000","last_clean":"2024-09-16T16:53:43.570208+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:53:43.570208+0000","last_undegraded":"2024-09-16T16:53:43.570208+0000","last_fullsized":"2024-09-16T16:53:43.570208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2542,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2542,"ondisk_log_size":2542,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224980,"kb_used_data":224980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52072748,"statfs":{"total":53552873472,"available":53322493952,"internally_reserved":0,"allocated":230379520,"data_stored":230379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":287300,"kb_used_data":287300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52010428,"statfs":{"total":53552873472,"available":53258678272,"internally_reserved":0,"allocated":294195200,"data_stored":294195200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":193856,"kb_used_data":193856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52103872,"statfs":{"total":53552873472,"available":53354364928,"internally_reserved":0,"allocated":198508544,"data_stored":198508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":264756,"kb_used_data":264756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52032972,"statfs":{"total":53552873472,"available":53281763328,"internally_reserved":0,"allocated":271110144,"data_stored":271110144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:46.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:46.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:46.233+0000 7f091e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:46.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:46.245+0000 7f091e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:46.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 15 2856 2841 6.12226 6.5625 0.234654 0.162872 2024-09-16T16:53:47.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 2970 2954 6.15358 7.0625 0.0651106 0.161991 2024-09-16T16:53:48.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:48.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:48.797+0000 7f1c5b674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:48.807+0000 7f1c5b674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3068 3052 6.15264 6.125 0.260235 0.161996 2024-09-16T16:53:49.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:49.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.188+0000 7fb1a5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.202+0000 7fb1a5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.497 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:53:49.497 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:53:49.519 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-09-16T16:53:47.845421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167182899,"num_objects":2546,"num_object_clones":0,"num_object_copies":7638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2623,"num_write_kb":163796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2597,"ondisk_log_size":2597,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":970892,"kb_used_data":970892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208220020,"statfs":{"total":214211493888,"available":213217300480,"internally_reserved":0,"allocated":994193408,"data_stored":994193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2542,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002611"},"pg_stats":[{"pgid":"5.f","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.593339+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:53:43.593339+0000","last_peered":"2024-09-16T16:53:43.593339+0000","last_clean":"2024-09-16T16:53:43.593339+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:53:43.593339+0000","last_undegraded":"2024-09-16T16:53:43.593339+0000","last_fullsized":"2024-09-16T16:53:43.593339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.713613+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:53:43.713613+0000","last_peered":"2024-09-16T16:53:43.713613+0000","last_clean":"2024-09-16T16:53:43.713613+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:53:43.713613+0000","last_undegraded":"2024-09-16T16:53:43.713613+0000","last_fullsized":"2024-09-16T16:53:43.713613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.504621+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:53:43.504621+0000","last_peered":"2024-09-16T16:53:43.504621+0000","last_clean":"2024-09-16T16:53:43.504621+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:53:43.504621+0000","last_undegraded":"2024-09-16T16:53:43.504621+0000","last_fullsized":"2024-09-16T16:53:43.504621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.443166+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:53:43.443166+0000","last_peered":"2024-09-16T16:53:43.443166+0000","last_clean":"2024-09-16T16:53:43.443166+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:53:43.443166+0000","last_undegraded":"2024-09-16T16:53:43.443166+0000","last_fullsized":"2024-09-16T16:53:43.443166+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'153","reported_seq":174,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.624499+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:53:43.624499+0000","last_peered":"2024-09-16T16:53:43.624499+0000","last_clean":"2024-09-16T16:53:43.624499+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:53:43.624499+0000","last_undegraded":"2024-09-16T16:53:43.624499+0000","last_fullsized":"2024-09-16T16:53:43.624499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.498085+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:53:43.498085+0000","last_peered":"2024-09-16T16:53:43.498085+0000","last_clean":"2024-09-16T16:53:43.498085+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:53:43.498085+0000","last_undegraded":"2024-09-16T16:53:43.498085+0000","last_fullsized":"2024-09-16T16:53:43.498085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'152","reported_seq":173,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.669114+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:53:43.669114+0000","last_peered":"2024-09-16T16:53:43.669114+0000","last_clean":"2024-09-16T16:53:43.669114+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:53:43.669114+0000","last_undegraded":"2024-09-16T16:53:43.669114+0000","last_fullsized":"2024-09-16T16:53:43.669114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'146","reported_seq":167,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.351615+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:53:43.351615+0000","last_peered":"2024-09-16T16:53:43.351615+0000","last_clean":"2024-09-16T16:53:43.351615+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:53:43.351615+0000","last_undegraded":"2024-09-16T16:53:43.351615+0000","last_fullsized":"2024-09-16T16:53:43.351615+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'173","reported_seq":194,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.486439+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:53:43.486439+0000","last_peered":"2024-09-16T16:53:43.486439+0000","last_clean":"2024-09-16T16:53:43.486439+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:53:43.486439+0000","last_undegraded":"2024-09-16T16:53:43.486439+0000","last_fullsized":"2024-09-16T16:53:43.486439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'158","reported_seq":179,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.707756+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:53:43.707756+0000","last_peered":"2024-09-16T16:53:43.707756+0000","last_clean":"2024-09-16T16:53:43.707756+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:53:43.707756+0000","last_undegraded":"2024-09-16T16:53:43.707756+0000","last_fullsized":"2024-09-16T16:53:43.707756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'187","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.519178+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:53:43.519178+0000","last_peered":"2024-09-16T16:53:43.519178+0000","last_clean":"2024-09-16T16:53:43.519178+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:53:43.519178+0000","last_undegraded":"2024-09-16T16:53:43.519178+0000","last_fullsized":"2024-09-16T16:53:43.519178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.656317+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:53:43.656317+0000","last_peered":"2024-09-16T16:53:43.656317+0000","last_clean":"2024-09-16T16:53:43.656317+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:53:43.656317+0000","last_undegraded":"2024-09-16T16:53:43.656317+0000","last_fullsized":"2024-09-16T16:53:43.656317+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.556936+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:53:43.556936+0000","last_peered":"2024-09-16T16:53:43.556936+0000","last_clean":"2024-09-16T16:53:43.556936+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:53:43.556936+0000","last_undegraded":"2024-09-16T16:53:43.556936+0000","last_fullsized":"2024-09-16T16:53:43.556936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'144","reported_seq":165,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.435418+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:53:43.435418+0000","last_peered":"2024-09-16T16:53:43.435418+0000","last_clean":"2024-09-16T16:53:43.435418+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:53:43.435418+0000","last_undegraded":"2024-09-16T16:53:43.435418+0000","last_fullsized":"2024-09-16T16:53:43.435418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'163","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.662791+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:53:43.662791+0000","last_peered":"2024-09-16T16:53:43.662791+0000","last_clean":"2024-09-16T16:53:43.662791+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:53:43.662791+0000","last_undegraded":"2024-09-16T16:53:43.662791+0000","last_fullsized":"2024-09-16T16:53:43.662791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'139","reported_seq":160,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.570208+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:53:43.570208+0000","last_peered":"2024-09-16T16:53:43.570208+0000","last_clean":"2024-09-16T16:53:43.570208+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:53:43.570208+0000","last_undegraded":"2024-09-16T16:53:43.570208+0000","last_fullsized":"2024-09-16T16:53:43.570208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2542,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2542,"ondisk_log_size":2542,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224980,"kb_used_data":224980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52072748,"statfs":{"total":53552873472,"available":53322493952,"internally_reserved":0,"allocated":230379520,"data_stored":230379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":287300,"kb_used_data":287300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52010428,"statfs":{"total":53552873472,"available":53258678272,"internally_reserved":0,"allocated":294195200,"data_stored":294195200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":193856,"kb_used_data":193856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52103872,"statfs":{"total":53552873472,"available":53354364928,"internally_reserved":0,"allocated":198508544,"data_stored":198508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":264756,"kb_used_data":264756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52032972,"statfs":{"total":53552873472,"available":53281763328,"internally_reserved":0,"allocated":271110144,"data_stored":271110144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:49.520 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:53:49.521 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:49.521 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:49.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:49.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.657+0000 7f8d3e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.668+0000 7f8d3e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:49.690 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:49.691 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:49.691 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:49.695 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:49.695 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:49.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:49.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.827+0000 7f2d3d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:49.845+0000 7f2d3d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:49.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 3173 3157 6.16543 6.5625 0.430594 0.161427 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:49.912 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:49.912 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:49.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:50.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:50.060+0000 7fb994108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:50.078+0000 7fb994108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:50.174 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:50.178 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:50.178 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:50.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:50.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:50.313+0000 7f7fe7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:50.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:50.331+0000 7f7fe7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:50.371 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:50.372 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:50.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:50.376 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:50.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 3298 3282 6.21531 7.8125 0.117296 0.16025 2024-09-16T16:53:51.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:51.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:51.243+0000 7fa0c9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:51.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:51.252+0000 7fa0c9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:51.856 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 3414 3398 6.24572 7.25 0.0886148 0.159552 2024-09-16T16:53:52.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 3517 3501 6.25119 6.4375 0.130825 0.159655 2024-09-16T16:53:53.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:53.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:53.659+0000 7f8818351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:53.666+0000 7f8818351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 3622 3606 6.25982 6.5625 0.137221 0.159411 2024-09-16T16:53:54.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 3737 3721 6.28487 7.1875 0.0612286 0.158701 2024-09-16T16:53:55.377 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:55.377 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:55.378 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:55.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:55.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.529+0000 7f1a36ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.540+0000 7f1a36ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:55.574 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:55.575 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:55.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:55.578 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:55.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:55.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.706+0000 7f1888991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.722+0000 7f1888991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:55.792 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:55.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:55.796 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:55.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:55.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:55.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 3828 3812 6.26914 5.6875 0.0436907 0.158486 2024-09-16T16:53:55.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.974+0000 7fb946711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:55.989+0000 7fb946711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:56.010+0000 7fdade463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:56.020+0000 7fdade463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.047 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:56.048 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:56.049 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:56.052 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:56.052 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:56.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:56.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:56.214+0000 7f066c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:56.227+0000 7f066c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:53:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:53:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:53:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:53:56.268 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:53:56.269 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:53:56.272 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:56.272 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:56.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 3919 3903 6.25421 5.6875 0.333361 0.159565 2024-09-16T16:53:57.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:53:57.857652+0000 min lat: 0.0199272 max lat: 0.999889 avg lat: 0.159427 2024-09-16T16:53:57.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:57.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 4018 4002 6.25253 6.1875 0.496095 0.159427 2024-09-16T16:53:58.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:58.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:58.423+0000 7fa8b3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:58.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:53:58.432+0000 7fa8b3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:58.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 4126 4110 6.26464 6.75 0.190357 0.159187 2024-09-16T16:53:59.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 4229 4213 6.26874 6.4375 0.0638342 0.159026 2024-09-16T16:54:00.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 4341 4325 6.28573 7 0.0950165 0.158629 2024-09-16T16:54:00.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:01.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:01.003+0000 7ff79cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:01.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:01.013+0000 7ff79cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:01.273 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:01.274 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:01.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:01.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:01.427+0000 7f7063b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:01.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:01.438+0000 7f7063b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:01.732 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:54:01.733 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:54:01.755 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-09-16T16:53:59.848040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":167182899,"num_objects":2546,"num_object_clones":0,"num_object_copies":7638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2623,"num_write_kb":163796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2597,"ondisk_log_size":2597,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":970892,"kb_used_data":970892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208220020,"statfs":{"total":214211493888,"available":213217300480,"internally_reserved":0,"allocated":994193408,"data_stored":994193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002619"},"pg_stats":[{"pgid":"5.f","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.593339+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:53:43.593339+0000","last_peered":"2024-09-16T16:53:43.593339+0000","last_clean":"2024-09-16T16:53:43.593339+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:53:43.593339+0000","last_undegraded":"2024-09-16T16:53:43.593339+0000","last_fullsized":"2024-09-16T16:53:43.593339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.713613+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:53:43.713613+0000","last_peered":"2024-09-16T16:53:43.713613+0000","last_clean":"2024-09-16T16:53:43.713613+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:53:43.713613+0000","last_undegraded":"2024-09-16T16:53:43.713613+0000","last_fullsized":"2024-09-16T16:53:43.713613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.504621+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:53:43.504621+0000","last_peered":"2024-09-16T16:53:43.504621+0000","last_clean":"2024-09-16T16:53:43.504621+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:53:43.504621+0000","last_undegraded":"2024-09-16T16:53:43.504621+0000","last_fullsized":"2024-09-16T16:53:43.504621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.443166+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:53:43.443166+0000","last_peered":"2024-09-16T16:53:43.443166+0000","last_clean":"2024-09-16T16:53:43.443166+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:53:43.443166+0000","last_undegraded":"2024-09-16T16:53:43.443166+0000","last_fullsized":"2024-09-16T16:53:43.443166+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'153","reported_seq":174,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.624499+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:53:43.624499+0000","last_peered":"2024-09-16T16:53:43.624499+0000","last_clean":"2024-09-16T16:53:43.624499+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:53:43.624499+0000","last_undegraded":"2024-09-16T16:53:43.624499+0000","last_fullsized":"2024-09-16T16:53:43.624499+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'165","reported_seq":186,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.498085+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:53:43.498085+0000","last_peered":"2024-09-16T16:53:43.498085+0000","last_clean":"2024-09-16T16:53:43.498085+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:53:43.498085+0000","last_undegraded":"2024-09-16T16:53:43.498085+0000","last_fullsized":"2024-09-16T16:53:43.498085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":10560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'152","reported_seq":173,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.669114+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:53:43.669114+0000","last_peered":"2024-09-16T16:53:43.669114+0000","last_clean":"2024-09-16T16:53:43.669114+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:53:43.669114+0000","last_undegraded":"2024-09-16T16:53:43.669114+0000","last_fullsized":"2024-09-16T16:53:43.669114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":9728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'146","reported_seq":167,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.351615+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:53:43.351615+0000","last_peered":"2024-09-16T16:53:43.351615+0000","last_clean":"2024-09-16T16:53:43.351615+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:53:43.351615+0000","last_undegraded":"2024-09-16T16:53:43.351615+0000","last_fullsized":"2024-09-16T16:53:43.351615+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'173","reported_seq":194,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.486439+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:53:43.486439+0000","last_peered":"2024-09-16T16:53:43.486439+0000","last_clean":"2024-09-16T16:53:43.486439+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:53:43.486439+0000","last_undegraded":"2024-09-16T16:53:43.486439+0000","last_fullsized":"2024-09-16T16:53:43.486439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'158","reported_seq":179,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.707756+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:53:43.707756+0000","last_peered":"2024-09-16T16:53:43.707756+0000","last_clean":"2024-09-16T16:53:43.707756+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:53:43.707756+0000","last_undegraded":"2024-09-16T16:53:43.707756+0000","last_fullsized":"2024-09-16T16:53:43.707756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10354688,"num_objects":158,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":10112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'187","reported_seq":208,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.519178+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:53:43.519178+0000","last_peered":"2024-09-16T16:53:43.519178+0000","last_clean":"2024-09-16T16:53:43.519178+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:53:43.519178+0000","last_undegraded":"2024-09-16T16:53:43.519178+0000","last_fullsized":"2024-09-16T16:53:43.519178+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":11968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'155","reported_seq":176,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.656317+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:53:43.656317+0000","last_peered":"2024-09-16T16:53:43.656317+0000","last_clean":"2024-09-16T16:53:43.656317+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:53:43.656317+0000","last_undegraded":"2024-09-16T16:53:43.656317+0000","last_fullsized":"2024-09-16T16:53:43.656317+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":9920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'161","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.556936+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:53:43.556936+0000","last_peered":"2024-09-16T16:53:43.556936+0000","last_clean":"2024-09-16T16:53:43.556936+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:53:43.556936+0000","last_undegraded":"2024-09-16T16:53:43.556936+0000","last_fullsized":"2024-09-16T16:53:43.556936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'144","reported_seq":165,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.435418+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:53:43.435418+0000","last_peered":"2024-09-16T16:53:43.435418+0000","last_clean":"2024-09-16T16:53:43.435418+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:53:43.435418+0000","last_undegraded":"2024-09-16T16:53:43.435418+0000","last_fullsized":"2024-09-16T16:53:43.435418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'163","reported_seq":184,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.662791+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:53:43.662791+0000","last_peered":"2024-09-16T16:53:43.662791+0000","last_clean":"2024-09-16T16:53:43.662791+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:53:43.662791+0000","last_undegraded":"2024-09-16T16:53:43.662791+0000","last_fullsized":"2024-09-16T16:53:43.662791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682368,"num_objects":163,"num_object_clones":0,"num_object_copies":489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":10432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'139","reported_seq":160,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:43.570208+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:53:43.570208+0000","last_peered":"2024-09-16T16:53:43.570208+0000","last_clean":"2024-09-16T16:53:43.570208+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:53:43.570208+0000","last_undegraded":"2024-09-16T16:53:43.570208+0000","last_fullsized":"2024-09-16T16:53:43.570208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":166592512,"num_objects":2542,"num_object_clones":0,"num_object_copies":7626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2542,"num_write_kb":162688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2542,"ondisk_log_size":2542,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213196636160,"internally_reserved":0,"allocated":1014857728,"data_stored":1014857728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224980,"kb_used_data":224980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52072748,"statfs":{"total":53552873472,"available":53322493952,"internally_reserved":0,"allocated":230379520,"data_stored":230379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":287300,"kb_used_data":287300,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52010428,"statfs":{"total":53552873472,"available":53258678272,"internally_reserved":0,"allocated":294195200,"data_stored":294195200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":193856,"kb_used_data":193856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52103872,"statfs":{"total":53552873472,"available":53354364928,"internally_reserved":0,"allocated":198508544,"data_stored":198508544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":264756,"kb_used_data":264756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52032972,"statfs":{"total":53552873472,"available":53281763328,"internally_reserved":0,"allocated":271110144,"data_stored":271110144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53278334976,"internally_reserved":0,"allocated":274538496,"data_stored":274538496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53348724736,"internally_reserved":0,"allocated":204148736,"data_stored":204148736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53253152768,"internally_reserved":0,"allocated":299720704,"data_stored":299720704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53316423680,"internally_reserved":0,"allocated":236449792,"data_stored":236449792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:01.857 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 4449 4433 6.29627 6.75 0.078702 0.158426 2024-09-16T16:54:02.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 4562 4546 6.31328 7.0625 0.201598 0.15816 2024-09-16T16:54:03.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:03.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:03.429+0000 7fd342391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:03.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:03.437+0000 7fd342391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:03.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 4683 4667 6.34042 7.5625 0.120781 0.15745 2024-09-16T16:54:04.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 4790 4774 6.3478 6.6875 0.0784717 0.156964 2024-09-16T16:54:05.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:05.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 4896 4880 6.35355 6.625 0.0780015 0.157093 2024-09-16T16:54:05.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:05.955+0000 7f50cfa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:05.962+0000 7f50cfa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:06.757 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:06.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:06.758 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:06.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:06.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 5012 4996 6.37183 7.25 0.100083 0.156745 2024-09-16T16:54:06.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:06.934+0000 7f5a2cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:06.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:06.950+0000 7f5a2cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:06.987 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:06.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:06.991 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:06.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:07.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.148+0000 7f77d1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.166+0000 7f77d1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:07.217 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:07.218 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:07.218 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:07.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:07.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:07.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:07.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.364+0000 7fccb4a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.376+0000 7fccb4a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:07.454 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:07.455 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:07.459 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:07.459 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:07.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:07.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.611+0000 7f0ea6223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:07.623+0000 7f0ea6223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:07.746 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:07.747 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:07.751 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:07.751 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:07.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 5122 5106 6.38188 6.875 0.076759 0.156354 2024-09-16T16:54:08.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:08.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:08.395+0000 7fefe1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:08.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:08.402+0000 7fefe1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:08.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 5227 5211 6.38542 6.5625 0.0854982 0.156337 2024-09-16T16:54:09.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 5333 5317 6.39001 6.625 0.254137 0.156252 2024-09-16T16:54:10.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:10.846+0000 7faee4e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:10.853+0000 7faee4e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:10.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 5444 5428 6.40033 6.9375 0.0979694 0.155993 2024-09-16T16:54:11.858 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 5555 5539 6.41027 6.9375 0.114888 0.155756 2024-09-16T16:54:12.752 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:12.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:12.752 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:12.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:12.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 5671 5655 6.42552 7.25 0.0657662 0.155333 2024-09-16T16:54:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:12.935+0000 7f127f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:12.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:12.953+0000 7f127f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:13.003 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:13.003 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:13.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:13.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.136+0000 7f1ac8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.150+0000 7f1ac8f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:13.174 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:13.175 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:13.178 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:13.178 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:13.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:13.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.327+0000 7f3be2151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.344+0000 7f3be2151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.385+0000 7f9e72191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.395+0000 7f9e72191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:13.428 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:13.431 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:13.432 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:13.432 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:13.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.565+0000 7fc7f9f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:13.576+0000 7fc7f9f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:13.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:13.650 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:13.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 5767 5751 6.41791 6 0.0569641 0.155648 2024-09-16T16:54:14.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 5859 5843 6.40618 5.75 0.294312 0.155614 2024-09-16T16:54:15.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:15.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:15.762+0000 7f09818bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:15.771+0000 7f09818bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 5958 5942 6.4024 6.1875 0.104221 0.15587 2024-09-16T16:54:16.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 6064 6048 6.40616 6.625 0.127573 0.155902 2024-09-16T16:54:17.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:54:17.859604+0000 min lat: 0.0199272 max lat: 0.999889 avg lat: 0.155913 2024-09-16T16:54:17.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:54:17.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 6155 6139 6.39417 5.6875 0.112623 0.155913 2024-09-16T16:54:18.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:18.214+0000 7f500ded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:18.221+0000 7f500ded1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:18.651 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:18.651 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:18.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:18.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:18.796+0000 7fcdbd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:18.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:18.809+0000 7fcdbd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:18.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 6248 6232 6.38463 5.8125 0.0871476 0.156244 2024-09-16T16:54:19.187 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:54:19.187 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:54:19.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-16T16:54:17.851723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":377946675,"num_objects":5762,"num_object_clones":0,"num_object_copies":17286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5839,"num_write_kb":369620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5813,"ondisk_log_size":5813,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2221016,"kb_used_data":2221016,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206969896,"statfs":{"total":214211493888,"available":211937173504,"internally_reserved":0,"allocated":2274320384,"data_stored":2274320384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":210763776,"num_objects":3216,"num_object_clones":0,"num_object_copies":9648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3216,"num_write_kb":205824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002519"},"pg_stats":[{"pgid":"5.f","version":"50'388","reported_seq":409,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.742704+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:13.742704+0000","last_peered":"2024-09-16T16:54:13.742704+0000","last_clean":"2024-09-16T16:54:13.742704+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:13.742704+0000","last_undegraded":"2024-09-16T16:54:13.742704+0000","last_fullsized":"2024-09-16T16:54:13.742704+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'376","reported_seq":397,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.678853+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:13.678853+0000","last_peered":"2024-09-16T16:54:13.678853+0000","last_clean":"2024-09-16T16:54:13.678853+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:13.678853+0000","last_undegraded":"2024-09-16T16:54:13.678853+0000","last_fullsized":"2024-09-16T16:54:13.678853+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.525599+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:13.525599+0000","last_peered":"2024-09-16T16:54:13.525599+0000","last_clean":"2024-09-16T16:54:13.525599+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:13.525599+0000","last_undegraded":"2024-09-16T16:54:13.525599+0000","last_fullsized":"2024-09-16T16:54:13.525599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'353","reported_seq":374,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.100621+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:13.100621+0000","last_peered":"2024-09-16T16:54:13.100621+0000","last_clean":"2024-09-16T16:54:13.100621+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:13.100621+0000","last_undegraded":"2024-09-16T16:54:13.100621+0000","last_fullsized":"2024-09-16T16:54:13.100621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.728302+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:13.728302+0000","last_peered":"2024-09-16T16:54:13.728302+0000","last_clean":"2024-09-16T16:54:13.728302+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:13.728302+0000","last_undegraded":"2024-09-16T16:54:13.728302+0000","last_fullsized":"2024-09-16T16:54:13.728302+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.927948+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:13.927948+0000","last_peered":"2024-09-16T16:54:13.927948+0000","last_clean":"2024-09-16T16:54:13.927948+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:13.927948+0000","last_undegraded":"2024-09-16T16:54:13.927948+0000","last_fullsized":"2024-09-16T16:54:13.927948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.389226+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:13.389226+0000","last_peered":"2024-09-16T16:54:13.389226+0000","last_clean":"2024-09-16T16:54:13.389226+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:13.389226+0000","last_undegraded":"2024-09-16T16:54:13.389226+0000","last_fullsized":"2024-09-16T16:54:13.389226+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'357","reported_seq":378,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.315593+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:13.315593+0000","last_peered":"2024-09-16T16:54:13.315593+0000","last_clean":"2024-09-16T16:54:13.315593+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:13.315593+0000","last_undegraded":"2024-09-16T16:54:13.315593+0000","last_fullsized":"2024-09-16T16:54:13.315593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'361","reported_seq":382,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.249034+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:13.249034+0000","last_peered":"2024-09-16T16:54:13.249034+0000","last_clean":"2024-09-16T16:54:13.249034+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:13.249034+0000","last_undegraded":"2024-09-16T16:54:13.249034+0000","last_fullsized":"2024-09-16T16:54:13.249034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'374","reported_seq":395,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.310446+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:13.310446+0000","last_peered":"2024-09-16T16:54:13.310446+0000","last_clean":"2024-09-16T16:54:13.310446+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:13.310446+0000","last_undegraded":"2024-09-16T16:54:13.310446+0000","last_fullsized":"2024-09-16T16:54:13.310446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'355","reported_seq":376,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.324694+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:13.324694+0000","last_peered":"2024-09-16T16:54:13.324694+0000","last_clean":"2024-09-16T16:54:13.324694+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:13.324694+0000","last_undegraded":"2024-09-16T16:54:13.324694+0000","last_fullsized":"2024-09-16T16:54:13.324694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'364","reported_seq":385,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.647701+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:13.647701+0000","last_peered":"2024-09-16T16:54:13.647701+0000","last_clean":"2024-09-16T16:54:13.647701+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:13.647701+0000","last_undegraded":"2024-09-16T16:54:13.647701+0000","last_fullsized":"2024-09-16T16:54:13.647701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'368","reported_seq":389,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.552636+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:13.552636+0000","last_peered":"2024-09-16T16:54:13.552636+0000","last_clean":"2024-09-16T16:54:13.552636+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:13.552636+0000","last_undegraded":"2024-09-16T16:54:13.552636+0000","last_fullsized":"2024-09-16T16:54:13.552636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'329","reported_seq":350,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.691581+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:13.691581+0000","last_peered":"2024-09-16T16:54:13.691581+0000","last_clean":"2024-09-16T16:54:13.691581+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:13.691581+0000","last_undegraded":"2024-09-16T16:54:13.691581+0000","last_fullsized":"2024-09-16T16:54:13.691581+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.847215+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:13.847215+0000","last_peered":"2024-09-16T16:54:13.847215+0000","last_clean":"2024-09-16T16:54:13.847215+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:13.847215+0000","last_undegraded":"2024-09-16T16:54:13.847215+0000","last_fullsized":"2024-09-16T16:54:13.847215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'349","reported_seq":370,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.416064+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:13.416064+0000","last_peered":"2024-09-16T16:54:13.416064+0000","last_clean":"2024-09-16T16:54:13.416064+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:13.416064+0000","last_undegraded":"2024-09-16T16:54:13.416064+0000","last_fullsized":"2024-09-16T16:54:13.416064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":22336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":377356288,"num_objects":5758,"num_object_clones":0,"num_object_copies":17274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5758,"num_write_kb":368512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211919925248,"internally_reserved":0,"allocated":2291568640,"data_stored":2291568640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5758,"ondisk_log_size":5758,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211920056320,"internally_reserved":0,"allocated":2291437568,"data_stored":2291437568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":508020,"kb_used_data":508020,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51789708,"statfs":{"total":53552873472,"available":53032660992,"internally_reserved":0,"allocated":520212480,"data_stored":520212480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":652820,"kb_used_data":652820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51644908,"statfs":{"total":53552873472,"available":52884385792,"internally_reserved":0,"allocated":668487680,"data_stored":668487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":458696,"kb_used_data":458696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51839032,"statfs":{"total":53552873472,"available":53083168768,"internally_reserved":0,"allocated":469704704,"data_stored":469704704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":601480,"kb_used_data":601480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51696248,"statfs":{"total":53552873472,"available":52936957952,"internally_reserved":0,"allocated":615915520,"data_stored":615915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52879306752,"internally_reserved":0,"allocated":673566720,"data_stored":673566720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52879175680,"internally_reserved":0,"allocated":673697792,"data_stored":673697792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:19.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 6339 6323 6.37338 5.6875 0.189153 0.156489 2024-09-16T16:54:20.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:20.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:20.614+0000 7f892d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:20.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:20.623+0000 7f892d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:20.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 6429 6413 6.36149 5.625 0.142332 0.156896 2024-09-16T16:54:21.859 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 6513 6497 6.34411 5.25 0.136158 0.15725 2024-09-16T16:54:22.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 6616 6600 6.34554 6.4375 0.100464 0.157345 2024-09-16T16:54:22.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:23.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:23.022+0000 7f556f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:23.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:23.030+0000 7f556f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:23.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 6707 6691 6.33556 5.6875 0.0567515 0.157498 2024-09-16T16:54:24.208 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:24.208 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:24.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:24.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:24.352+0000 7fdad127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:24.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:24.363+0000 7fdad127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:24.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:54:24.625 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:54:24.647 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-09-16T16:54:23.852935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":377946675,"num_objects":5762,"num_object_clones":0,"num_object_copies":17286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5839,"num_write_kb":369620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5813,"ondisk_log_size":5813,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2221016,"kb_used_data":2221016,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206969896,"statfs":{"total":214211493888,"available":211937173504,"internally_reserved":0,"allocated":2274320384,"data_stored":2274320384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":210763776,"num_objects":3216,"num_object_clones":0,"num_object_copies":9648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3216,"num_write_kb":205824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002625"},"pg_stats":[{"pgid":"5.f","version":"50'388","reported_seq":409,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.742704+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:13.742704+0000","last_peered":"2024-09-16T16:54:13.742704+0000","last_clean":"2024-09-16T16:54:13.742704+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:13.742704+0000","last_undegraded":"2024-09-16T16:54:13.742704+0000","last_fullsized":"2024-09-16T16:54:13.742704+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'376","reported_seq":397,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.678853+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:13.678853+0000","last_peered":"2024-09-16T16:54:13.678853+0000","last_clean":"2024-09-16T16:54:13.678853+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:13.678853+0000","last_undegraded":"2024-09-16T16:54:13.678853+0000","last_fullsized":"2024-09-16T16:54:13.678853+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.525599+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:13.525599+0000","last_peered":"2024-09-16T16:54:13.525599+0000","last_clean":"2024-09-16T16:54:13.525599+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:13.525599+0000","last_undegraded":"2024-09-16T16:54:13.525599+0000","last_fullsized":"2024-09-16T16:54:13.525599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'353","reported_seq":374,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.100621+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:13.100621+0000","last_peered":"2024-09-16T16:54:13.100621+0000","last_clean":"2024-09-16T16:54:13.100621+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:13.100621+0000","last_undegraded":"2024-09-16T16:54:13.100621+0000","last_fullsized":"2024-09-16T16:54:13.100621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.728302+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:13.728302+0000","last_peered":"2024-09-16T16:54:13.728302+0000","last_clean":"2024-09-16T16:54:13.728302+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:13.728302+0000","last_undegraded":"2024-09-16T16:54:13.728302+0000","last_fullsized":"2024-09-16T16:54:13.728302+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.927948+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:13.927948+0000","last_peered":"2024-09-16T16:54:13.927948+0000","last_clean":"2024-09-16T16:54:13.927948+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:13.927948+0000","last_undegraded":"2024-09-16T16:54:13.927948+0000","last_fullsized":"2024-09-16T16:54:13.927948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.389226+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:13.389226+0000","last_peered":"2024-09-16T16:54:13.389226+0000","last_clean":"2024-09-16T16:54:13.389226+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:13.389226+0000","last_undegraded":"2024-09-16T16:54:13.389226+0000","last_fullsized":"2024-09-16T16:54:13.389226+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'357","reported_seq":378,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.315593+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:13.315593+0000","last_peered":"2024-09-16T16:54:13.315593+0000","last_clean":"2024-09-16T16:54:13.315593+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:13.315593+0000","last_undegraded":"2024-09-16T16:54:13.315593+0000","last_fullsized":"2024-09-16T16:54:13.315593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'361","reported_seq":382,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.249034+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:13.249034+0000","last_peered":"2024-09-16T16:54:13.249034+0000","last_clean":"2024-09-16T16:54:13.249034+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:13.249034+0000","last_undegraded":"2024-09-16T16:54:13.249034+0000","last_fullsized":"2024-09-16T16:54:13.249034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'374","reported_seq":395,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.310446+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:13.310446+0000","last_peered":"2024-09-16T16:54:13.310446+0000","last_clean":"2024-09-16T16:54:13.310446+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:13.310446+0000","last_undegraded":"2024-09-16T16:54:13.310446+0000","last_fullsized":"2024-09-16T16:54:13.310446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'355","reported_seq":376,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.324694+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:13.324694+0000","last_peered":"2024-09-16T16:54:13.324694+0000","last_clean":"2024-09-16T16:54:13.324694+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:13.324694+0000","last_undegraded":"2024-09-16T16:54:13.324694+0000","last_fullsized":"2024-09-16T16:54:13.324694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'364","reported_seq":385,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.647701+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:13.647701+0000","last_peered":"2024-09-16T16:54:13.647701+0000","last_clean":"2024-09-16T16:54:13.647701+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:13.647701+0000","last_undegraded":"2024-09-16T16:54:13.647701+0000","last_fullsized":"2024-09-16T16:54:13.647701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'368","reported_seq":389,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.552636+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:13.552636+0000","last_peered":"2024-09-16T16:54:13.552636+0000","last_clean":"2024-09-16T16:54:13.552636+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:13.552636+0000","last_undegraded":"2024-09-16T16:54:13.552636+0000","last_fullsized":"2024-09-16T16:54:13.552636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'329","reported_seq":350,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.691581+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:13.691581+0000","last_peered":"2024-09-16T16:54:13.691581+0000","last_clean":"2024-09-16T16:54:13.691581+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:13.691581+0000","last_undegraded":"2024-09-16T16:54:13.691581+0000","last_fullsized":"2024-09-16T16:54:13.691581+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.847215+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:13.847215+0000","last_peered":"2024-09-16T16:54:13.847215+0000","last_clean":"2024-09-16T16:54:13.847215+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:13.847215+0000","last_undegraded":"2024-09-16T16:54:13.847215+0000","last_fullsized":"2024-09-16T16:54:13.847215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'349","reported_seq":370,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.416064+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:13.416064+0000","last_peered":"2024-09-16T16:54:13.416064+0000","last_clean":"2024-09-16T16:54:13.416064+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:13.416064+0000","last_undegraded":"2024-09-16T16:54:13.416064+0000","last_fullsized":"2024-09-16T16:54:13.416064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":22336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":377356288,"num_objects":5758,"num_object_clones":0,"num_object_copies":17274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5758,"num_write_kb":368512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211919925248,"internally_reserved":0,"allocated":2291568640,"data_stored":2291568640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5758,"ondisk_log_size":5758,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211920056320,"internally_reserved":0,"allocated":2291437568,"data_stored":2291437568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":508020,"kb_used_data":508020,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51789708,"statfs":{"total":53552873472,"available":53032660992,"internally_reserved":0,"allocated":520212480,"data_stored":520212480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":652820,"kb_used_data":652820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51644908,"statfs":{"total":53552873472,"available":52884385792,"internally_reserved":0,"allocated":668487680,"data_stored":668487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":458696,"kb_used_data":458696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51839032,"statfs":{"total":53552873472,"available":53083168768,"internally_reserved":0,"allocated":469704704,"data_stored":469704704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":601480,"kb_used_data":601480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51696248,"statfs":{"total":53552873472,"available":52936957952,"internally_reserved":0,"allocated":615915520,"data_stored":615915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52879306752,"internally_reserved":0,"allocated":673566720,"data_stored":673566720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52879175680,"internally_reserved":0,"allocated":673697792,"data_stored":673697792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:24.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 6797 6781 6.32495 5.625 0.0709716 0.15771 2024-09-16T16:54:25.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:25.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:25.431+0000 7fc26465c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:25.438+0000 7fc26465c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 6883 6867 6.31097 5.375 0.0979201 0.158099 2024-09-16T16:54:26.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 6980 6964 6.30736 6.0625 0.263531 0.158168 2024-09-16T16:54:27.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:27.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 7070 7054 6.2976 5.625 0.0846619 0.158474 2024-09-16T16:54:27.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:27.927+0000 7fc3ef511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:27.935+0000 7fc3ef511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 7155 7139 6.28372 5.3125 0.0516579 0.158734 2024-09-16T16:54:29.648 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:29.648 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:29.649 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:29.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:29.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:29.793+0000 7f067b26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:29.809+0000 7f067b26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:29.855 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:29.856 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:29.860 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:29.861 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:29.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:29.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 7256 7240 6.28411 6.3125 0.223025 0.158918 2024-09-16T16:54:29.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:29.987+0000 7f48b5ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.003+0000 7f48b5ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:30.038 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:30.038 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:30.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:30.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.206+0000 7facf8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.220+0000 7facf8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:30.247 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:30.248 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:30.251 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:30.251 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:30.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:30.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.386+0000 7efef5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.396+0000 7efef5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.442+0000 7fa1b92a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:30.459+0000 7fa1b92a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.484 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:30.485 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:30.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:30.489 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:30.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 7355 7339 6.28278 6.1875 0.110674 0.158854 2024-09-16T16:54:31.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 7471 7455 6.29584 7.25 0.106107 0.158684 2024-09-16T16:54:32.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:32.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:32.854+0000 7f3993e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:32.860 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 7579 7563 6.30189 6.75 0.115295 0.158508 2024-09-16T16:54:32.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:32.863+0000 7f3993e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:33.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 7680 7664 6.30202 6.3125 0.156568 0.158405 2024-09-16T16:54:34.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 7786 7770 6.3062 6.625 0.113766 0.158328 2024-09-16T16:54:35.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:35.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.315+0000 7f74e2cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.323+0000 7f74e2cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.490 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:35.490 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:35.490 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:35.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:35.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.663+0000 7f6dddd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.675+0000 7f6dddd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.758 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:35.758 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:35.758 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:35.758 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:35.758 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:35.759 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:35.763 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:35.764 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:35.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:35.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 7892 7876 6.31028 6.625 0.214206 0.158291 2024-09-16T16:54:35.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.931+0000 7f3a76791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:35.944+0000 7f3a76791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.972 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:35.972 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:35.976 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:35.977 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:35.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:36.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:36.137+0000 7fa020191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:36.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:36.149+0000 7fa020191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:36.173 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:36.173 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:36.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:36.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:36.334+0000 7f0a6ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:36.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:36.347+0000 7f0a6ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:36.392 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:36.396 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:36.396 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:36.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 7998 7982 6.31426 6.625 0.206343 0.158214 2024-09-16T16:54:37.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:37.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:54:37.861602+0000 min lat: 0.0199272 max lat: 0.999889 avg lat: 0.158219 2024-09-16T16:54:37.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:54:37.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 8094 8078 6.31032 6 0.149852 0.158219 2024-09-16T16:54:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:37.874+0000 7f4214c84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:37.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:37.882+0000 7f4214c84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:38.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 8201 8185 6.31497 6.6875 0.0520561 0.158131 2024-09-16T16:54:39.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 8306 8290 6.31798 6.5625 0.118376 0.158059 2024-09-16T16:54:40.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:40.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:40.371+0000 7fbf79f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:40.382+0000 7fbf79f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 8414 8398 6.32318 6.75 0.332513 0.157919 2024-09-16T16:54:41.398 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:41.398 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:41.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:41.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:41.534+0000 7fd0d3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:41.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:41.544+0000 7fd0d3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:41.780 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:54:41.780 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:54:41.796 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-16T16:54:39.856181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":377946675,"num_objects":5762,"num_object_clones":0,"num_object_copies":17286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5839,"num_write_kb":369620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5813,"ondisk_log_size":5813,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2221016,"kb_used_data":2221016,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206969896,"statfs":{"total":214211493888,"available":211937173504,"internally_reserved":0,"allocated":2274320384,"data_stored":2274320384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"5.f","version":"50'388","reported_seq":409,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.742704+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:13.742704+0000","last_peered":"2024-09-16T16:54:13.742704+0000","last_clean":"2024-09-16T16:54:13.742704+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:13.742704+0000","last_undegraded":"2024-09-16T16:54:13.742704+0000","last_fullsized":"2024-09-16T16:54:13.742704+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'376","reported_seq":397,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.678853+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:13.678853+0000","last_peered":"2024-09-16T16:54:13.678853+0000","last_clean":"2024-09-16T16:54:13.678853+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:13.678853+0000","last_undegraded":"2024-09-16T16:54:13.678853+0000","last_fullsized":"2024-09-16T16:54:13.678853+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.525599+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:13.525599+0000","last_peered":"2024-09-16T16:54:13.525599+0000","last_clean":"2024-09-16T16:54:13.525599+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:13.525599+0000","last_undegraded":"2024-09-16T16:54:13.525599+0000","last_fullsized":"2024-09-16T16:54:13.525599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'353","reported_seq":374,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.100621+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:13.100621+0000","last_peered":"2024-09-16T16:54:13.100621+0000","last_clean":"2024-09-16T16:54:13.100621+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:13.100621+0000","last_undegraded":"2024-09-16T16:54:13.100621+0000","last_fullsized":"2024-09-16T16:54:13.100621+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.728302+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:13.728302+0000","last_peered":"2024-09-16T16:54:13.728302+0000","last_clean":"2024-09-16T16:54:13.728302+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:13.728302+0000","last_undegraded":"2024-09-16T16:54:13.728302+0000","last_fullsized":"2024-09-16T16:54:13.728302+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'358","reported_seq":379,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.927948+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:13.927948+0000","last_peered":"2024-09-16T16:54:13.927948+0000","last_clean":"2024-09-16T16:54:13.927948+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:13.927948+0000","last_undegraded":"2024-09-16T16:54:13.927948+0000","last_fullsized":"2024-09-16T16:54:13.927948+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.389226+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:13.389226+0000","last_peered":"2024-09-16T16:54:13.389226+0000","last_clean":"2024-09-16T16:54:13.389226+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:13.389226+0000","last_undegraded":"2024-09-16T16:54:13.389226+0000","last_fullsized":"2024-09-16T16:54:13.389226+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'357","reported_seq":378,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.315593+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:13.315593+0000","last_peered":"2024-09-16T16:54:13.315593+0000","last_clean":"2024-09-16T16:54:13.315593+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:13.315593+0000","last_undegraded":"2024-09-16T16:54:13.315593+0000","last_fullsized":"2024-09-16T16:54:13.315593+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'361","reported_seq":382,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.249034+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:13.249034+0000","last_peered":"2024-09-16T16:54:13.249034+0000","last_clean":"2024-09-16T16:54:13.249034+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:13.249034+0000","last_undegraded":"2024-09-16T16:54:13.249034+0000","last_fullsized":"2024-09-16T16:54:13.249034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":23104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'374","reported_seq":395,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.310446+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:13.310446+0000","last_peered":"2024-09-16T16:54:13.310446+0000","last_clean":"2024-09-16T16:54:13.310446+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:13.310446+0000","last_undegraded":"2024-09-16T16:54:13.310446+0000","last_fullsized":"2024-09-16T16:54:13.310446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'355","reported_seq":376,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.324694+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:13.324694+0000","last_peered":"2024-09-16T16:54:13.324694+0000","last_clean":"2024-09-16T16:54:13.324694+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:13.324694+0000","last_undegraded":"2024-09-16T16:54:13.324694+0000","last_fullsized":"2024-09-16T16:54:13.324694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'364","reported_seq":385,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.647701+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:13.647701+0000","last_peered":"2024-09-16T16:54:13.647701+0000","last_clean":"2024-09-16T16:54:13.647701+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:13.647701+0000","last_undegraded":"2024-09-16T16:54:13.647701+0000","last_fullsized":"2024-09-16T16:54:13.647701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'368","reported_seq":389,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.552636+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:13.552636+0000","last_peered":"2024-09-16T16:54:13.552636+0000","last_clean":"2024-09-16T16:54:13.552636+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:13.552636+0000","last_undegraded":"2024-09-16T16:54:13.552636+0000","last_fullsized":"2024-09-16T16:54:13.552636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":23552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'329","reported_seq":350,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.691581+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:13.691581+0000","last_peered":"2024-09-16T16:54:13.691581+0000","last_clean":"2024-09-16T16:54:13.691581+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:13.691581+0000","last_undegraded":"2024-09-16T16:54:13.691581+0000","last_fullsized":"2024-09-16T16:54:13.691581+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'356","reported_seq":377,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.847215+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:13.847215+0000","last_peered":"2024-09-16T16:54:13.847215+0000","last_clean":"2024-09-16T16:54:13.847215+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:13.847215+0000","last_undegraded":"2024-09-16T16:54:13.847215+0000","last_fullsized":"2024-09-16T16:54:13.847215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'349","reported_seq":370,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:13.416064+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:13.416064+0000","last_peered":"2024-09-16T16:54:13.416064+0000","last_clean":"2024-09-16T16:54:13.416064+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:13.416064+0000","last_undegraded":"2024-09-16T16:54:13.416064+0000","last_fullsized":"2024-09-16T16:54:13.416064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":22336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":377356288,"num_objects":5758,"num_object_clones":0,"num_object_copies":17274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5758,"num_write_kb":368512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211919925248,"internally_reserved":0,"allocated":2291568640,"data_stored":2291568640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5758,"ondisk_log_size":5758,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211920056320,"internally_reserved":0,"allocated":2291437568,"data_stored":2291437568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":508020,"kb_used_data":508020,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51789708,"statfs":{"total":53552873472,"available":53032660992,"internally_reserved":0,"allocated":520212480,"data_stored":520212480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":652820,"kb_used_data":652820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51644908,"statfs":{"total":53552873472,"available":52884385792,"internally_reserved":0,"allocated":668487680,"data_stored":668487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":458696,"kb_used_data":458696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51839032,"statfs":{"total":53552873472,"available":53083168768,"internally_reserved":0,"allocated":469704704,"data_stored":469704704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":601480,"kb_used_data":601480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51696248,"statfs":{"total":53552873472,"available":52936957952,"internally_reserved":0,"allocated":615915520,"data_stored":615915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52879306752,"internally_reserved":0,"allocated":673566720,"data_stored":673566720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52933791744,"internally_reserved":0,"allocated":619081728,"data_stored":619081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53079875584,"internally_reserved":0,"allocated":472997888,"data_stored":472997888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52879175680,"internally_reserved":0,"allocated":673697792,"data_stored":673697792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53027082240,"internally_reserved":0,"allocated":525791232,"data_stored":525791232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:41.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 8518 8502 6.32528 6.5 0.222375 0.157847 2024-09-16T16:54:42.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:42.861 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 8625 8609 6.32953 6.6875 0.178824 0.157795 2024-09-16T16:54:42.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:42.965+0000 7f6b57c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:42.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:42.971+0000 7f6b57c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:43.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 8721 8705 6.32569 6 0.105451 0.15785 2024-09-16T16:54:44.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 8829 8813 6.33056 6.75 0.0822484 0.157762 2024-09-16T16:54:45.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:45.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:45.413+0000 7fa2c2e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:45.423+0000 7fa2c2e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 8926 8910 6.32751 6.0625 0.113255 0.157804 2024-09-16T16:54:46.798 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:46.799 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:46.799 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:46.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:46.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 9034 9018 6.33225 6.75 0.114565 0.157716 2024-09-16T16:54:46.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:46.947+0000 7fd783191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:46.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:46.959+0000 7fd783191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:47.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:47.017 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:47.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:47.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:47.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:47.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.151+0000 7f6e36f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.163+0000 7f6e36f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:47.215 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:47.216 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:47.216 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:47.216 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:47.216 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:47.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:47.219 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:47.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:47.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.387+0000 7f09fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.402+0000 7f09fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:47.522 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:47.525 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:47.526 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:47.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.676+0000 7f5278f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.689+0000 7f5278f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.782 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:47.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:47.795 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:47.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 15 9135 9120 6.33271 6.375 0.0703656 0.157647 2024-09-16T16:54:47.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.906+0000 7f25a4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:47.912+0000 7f25a4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:48.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.2594 2024-09-16T16:54:48.862 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 9135 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 6.32552 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.682727 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 7.8125 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 3.875 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 101 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 10.9236 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 125 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 62 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.157835 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.121071 2024-09-16T16:54:48.863 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 0.999889 2024-09-16T16:54:48.864 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0199272 2024-09-16T16:54:48.896 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:54:50.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:50.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:50.271+0000 7f6f9bc4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:50.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:50.277+0000 7f6f9bc4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:52.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:52.711+0000 7f041fc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:52.719+0000 7f041fc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:52.796 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:52.797 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:52.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:52.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:52.953+0000 7f91ed6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:52.966+0000 7f91ed6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:53.096 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:53.097 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:53.097 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:53.097 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:53.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:53.099 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:53.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:53.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.257+0000 7fe40ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.270+0000 7fe40ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.301 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:53.302 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:53.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:53.305 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:53.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.457+0000 7f7c3fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.469+0000 7f7c3fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.490 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:53.490 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:53.491 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:53.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:53.495 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:53.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.655+0000 7fa9bd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:53.673+0000 7fa9bd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:54:53.714 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:54:53.715 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:54:53.715 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:54:53.715 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:54:53.718 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:53.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:55.036 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:55.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:55.200+0000 7f76d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:55.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:55.210+0000 7f76d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:57.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:57.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:57.600+0000 7fccc0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:57.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:57.607+0000 7fccc0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:58.720 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:58.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:54:58.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:58.864+0000 7fa24905c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:58.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:54:58.879+0000 7fa24905c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:54:59.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:54:59.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:00.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:00.081+0000 7f0bea551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:00.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:00.105+0000 7f0bea551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:00.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:00.165+0000 7fa1dc246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:00.175+0000 7fa1dc246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:00.929 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:55:00.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:55:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:01.094+0000 7f8435088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:01.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:01.108+0000 7f8435088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:01.929 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:55:01.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:55:02.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:02.079+0000 7f1117493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:02.093+0000 7f1117493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:02.607+0000 7f7379288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:02.616+0000 7f7379288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:55:02.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:55:02.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:03.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:03.109+0000 7f8152d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:03.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:03.127+0000 7f8152d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:03.507 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:03.507 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-16T16:55:02.935673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":571998771,"num_objects":8723,"num_object_clones":0,"num_object_copies":26169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8800,"num_write_kb":559124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8774,"ondisk_log_size":8774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3367012,"kb_used_data":3367012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205823900,"statfs":{"total":214211493888,"available":210763673600,"internally_reserved":0,"allocated":3447820288,"data_stored":3447820288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.075605"},"pg_stats":[{"pgid":"5.f","version":"50'584","reported_seq":605,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.246000+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:43.246000+0000","last_peered":"2024-09-16T16:54:43.246000+0000","last_clean":"2024-09-16T16:54:43.246000+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:43.246000+0000","last_undegraded":"2024-09-16T16:54:43.246000+0000","last_fullsized":"2024-09-16T16:54:43.246000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'571","reported_seq":592,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.763785+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:43.763785+0000","last_peered":"2024-09-16T16:54:43.763785+0000","last_clean":"2024-09-16T16:54:43.763785+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:43.763785+0000","last_undegraded":"2024-09-16T16:54:43.763785+0000","last_fullsized":"2024-09-16T16:54:43.763785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37421056,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":571,"num_write_kb":36544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'528","reported_seq":549,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.553797+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:43.553797+0000","last_peered":"2024-09-16T16:54:43.553797+0000","last_clean":"2024-09-16T16:54:43.553797+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:43.553797+0000","last_undegraded":"2024-09-16T16:54:43.553797+0000","last_fullsized":"2024-09-16T16:54:43.553797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'525","reported_seq":546,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.671837+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:43.671837+0000","last_peered":"2024-09-16T16:54:43.671837+0000","last_clean":"2024-09-16T16:54:43.671837+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:43.671837+0000","last_undegraded":"2024-09-16T16:54:43.671837+0000","last_fullsized":"2024-09-16T16:54:43.671837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'545","reported_seq":566,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.552760+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:43.552760+0000","last_peered":"2024-09-16T16:54:43.552760+0000","last_clean":"2024-09-16T16:54:43.552760+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:43.552760+0000","last_undegraded":"2024-09-16T16:54:43.552760+0000","last_fullsized":"2024-09-16T16:54:43.552760+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'555","reported_seq":576,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.343544+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:43.343544+0000","last_peered":"2024-09-16T16:54:43.343544+0000","last_clean":"2024-09-16T16:54:43.343544+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:43.343544+0000","last_undegraded":"2024-09-16T16:54:43.343544+0000","last_fullsized":"2024-09-16T16:54:43.343544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'534","reported_seq":555,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.540898+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:43.540898+0000","last_peered":"2024-09-16T16:54:43.540898+0000","last_clean":"2024-09-16T16:54:43.540898+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:43.540898+0000","last_undegraded":"2024-09-16T16:54:43.540898+0000","last_fullsized":"2024-09-16T16:54:43.540898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34996224,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'540","reported_seq":561,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.622360+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:43.622360+0000","last_peered":"2024-09-16T16:54:43.622360+0000","last_clean":"2024-09-16T16:54:43.622360+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:43.622360+0000","last_undegraded":"2024-09-16T16:54:43.622360+0000","last_fullsized":"2024-09-16T16:54:43.622360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'553","reported_seq":574,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.865157+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:43.865157+0000","last_peered":"2024-09-16T16:54:43.865157+0000","last_clean":"2024-09-16T16:54:43.865157+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:43.865157+0000","last_undegraded":"2024-09-16T16:54:43.865157+0000","last_fullsized":"2024-09-16T16:54:43.865157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'581","reported_seq":602,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.720806+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:43.720806+0000","last_peered":"2024-09-16T16:54:43.720806+0000","last_clean":"2024-09-16T16:54:43.720806+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:43.720806+0000","last_undegraded":"2024-09-16T16:54:43.720806+0000","last_fullsized":"2024-09-16T16:54:43.720806+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38076416,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":37184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'548","reported_seq":569,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.487481+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:43.487481+0000","last_peered":"2024-09-16T16:54:43.487481+0000","last_clean":"2024-09-16T16:54:43.487481+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:43.487481+0000","last_undegraded":"2024-09-16T16:54:43.487481+0000","last_fullsized":"2024-09-16T16:54:43.487481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'562","reported_seq":583,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.869032+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:43.869032+0000","last_peered":"2024-09-16T16:54:43.869032+0000","last_clean":"2024-09-16T16:54:43.869032+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:43.869032+0000","last_undegraded":"2024-09-16T16:54:43.869032+0000","last_fullsized":"2024-09-16T16:54:43.869032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'527","reported_seq":548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.674741+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:43.674741+0000","last_peered":"2024-09-16T16:54:43.674741+0000","last_clean":"2024-09-16T16:54:43.674741+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:43.674741+0000","last_undegraded":"2024-09-16T16:54:43.674741+0000","last_fullsized":"2024-09-16T16:54:43.674741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34537472,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'517","reported_seq":538,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.676193+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:43.676193+0000","last_peered":"2024-09-16T16:54:43.676193+0000","last_clean":"2024-09-16T16:54:43.676193+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:43.676193+0000","last_undegraded":"2024-09-16T16:54:43.676193+0000","last_fullsized":"2024-09-16T16:54:43.676193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'529","reported_seq":550,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.316925+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:43.316925+0000","last_peered":"2024-09-16T16:54:43.316925+0000","last_clean":"2024-09-16T16:54:43.316925+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:43.316925+0000","last_undegraded":"2024-09-16T16:54:43.316925+0000","last_fullsized":"2024-09-16T16:54:43.316925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'520","reported_seq":541,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.313571+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:43.313571+0000","last_peered":"2024-09-16T16:54:43.313571+0000","last_clean":"2024-09-16T16:54:43.313571+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:43.313571+0000","last_undegraded":"2024-09-16T16:54:43.313571+0000","last_fullsized":"2024-09-16T16:54:43.313571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":571408384,"num_objects":8719,"num_object_clones":0,"num_object_copies":26157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8719,"num_write_kb":558016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8719,"ondisk_log_size":8719,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":770108,"kb_used_data":770108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51527620,"statfs":{"total":53552873472,"available":52764282880,"internally_reserved":0,"allocated":788590592,"data_stored":788590592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":987308,"kb_used_data":987308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51310420,"statfs":{"total":53552873472,"available":52541870080,"internally_reserved":0,"allocated":1011003392,"data_stored":1011003392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":693840,"kb_used_data":693840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51603888,"statfs":{"total":53552873472,"available":52842381312,"internally_reserved":0,"allocated":710492160,"data_stored":710492160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":915756,"kb_used_data":915756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51381972,"statfs":{"total":53552873472,"available":52615139328,"internally_reserved":0,"allocated":937734144,"data_stored":937734144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:03.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:03.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:03.670+0000 7f0a95ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:03.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:03.682+0000 7f0a95ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:03.952 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:03.952 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:03.972 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-16T16:55:03.861259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":571998771,"num_objects":8723,"num_object_clones":0,"num_object_copies":26169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8800,"num_write_kb":559124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8774,"ondisk_log_size":8774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3367012,"kb_used_data":3367012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205823900,"statfs":{"total":214211493888,"available":210763673600,"internally_reserved":0,"allocated":3447820288,"data_stored":3447820288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000807"},"pg_stats":[{"pgid":"5.f","version":"50'584","reported_seq":605,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.246000+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:43.246000+0000","last_peered":"2024-09-16T16:54:43.246000+0000","last_clean":"2024-09-16T16:54:43.246000+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:43.246000+0000","last_undegraded":"2024-09-16T16:54:43.246000+0000","last_fullsized":"2024-09-16T16:54:43.246000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'571","reported_seq":592,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.763785+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:43.763785+0000","last_peered":"2024-09-16T16:54:43.763785+0000","last_clean":"2024-09-16T16:54:43.763785+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:43.763785+0000","last_undegraded":"2024-09-16T16:54:43.763785+0000","last_fullsized":"2024-09-16T16:54:43.763785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37421056,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":571,"num_write_kb":36544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'528","reported_seq":549,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.553797+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:43.553797+0000","last_peered":"2024-09-16T16:54:43.553797+0000","last_clean":"2024-09-16T16:54:43.553797+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:43.553797+0000","last_undegraded":"2024-09-16T16:54:43.553797+0000","last_fullsized":"2024-09-16T16:54:43.553797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'525","reported_seq":546,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.671837+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:43.671837+0000","last_peered":"2024-09-16T16:54:43.671837+0000","last_clean":"2024-09-16T16:54:43.671837+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:43.671837+0000","last_undegraded":"2024-09-16T16:54:43.671837+0000","last_fullsized":"2024-09-16T16:54:43.671837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'545","reported_seq":566,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.552760+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:43.552760+0000","last_peered":"2024-09-16T16:54:43.552760+0000","last_clean":"2024-09-16T16:54:43.552760+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:43.552760+0000","last_undegraded":"2024-09-16T16:54:43.552760+0000","last_fullsized":"2024-09-16T16:54:43.552760+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'555","reported_seq":576,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.343544+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:43.343544+0000","last_peered":"2024-09-16T16:54:43.343544+0000","last_clean":"2024-09-16T16:54:43.343544+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:43.343544+0000","last_undegraded":"2024-09-16T16:54:43.343544+0000","last_fullsized":"2024-09-16T16:54:43.343544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'534","reported_seq":555,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.540898+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:43.540898+0000","last_peered":"2024-09-16T16:54:43.540898+0000","last_clean":"2024-09-16T16:54:43.540898+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:43.540898+0000","last_undegraded":"2024-09-16T16:54:43.540898+0000","last_fullsized":"2024-09-16T16:54:43.540898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34996224,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'540","reported_seq":561,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.622360+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:43.622360+0000","last_peered":"2024-09-16T16:54:43.622360+0000","last_clean":"2024-09-16T16:54:43.622360+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:43.622360+0000","last_undegraded":"2024-09-16T16:54:43.622360+0000","last_fullsized":"2024-09-16T16:54:43.622360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'553","reported_seq":574,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.865157+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:43.865157+0000","last_peered":"2024-09-16T16:54:43.865157+0000","last_clean":"2024-09-16T16:54:43.865157+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:43.865157+0000","last_undegraded":"2024-09-16T16:54:43.865157+0000","last_fullsized":"2024-09-16T16:54:43.865157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'581","reported_seq":602,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.720806+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:43.720806+0000","last_peered":"2024-09-16T16:54:43.720806+0000","last_clean":"2024-09-16T16:54:43.720806+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:43.720806+0000","last_undegraded":"2024-09-16T16:54:43.720806+0000","last_fullsized":"2024-09-16T16:54:43.720806+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38076416,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":37184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'548","reported_seq":569,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.487481+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:43.487481+0000","last_peered":"2024-09-16T16:54:43.487481+0000","last_clean":"2024-09-16T16:54:43.487481+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:43.487481+0000","last_undegraded":"2024-09-16T16:54:43.487481+0000","last_fullsized":"2024-09-16T16:54:43.487481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'562","reported_seq":583,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.869032+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:43.869032+0000","last_peered":"2024-09-16T16:54:43.869032+0000","last_clean":"2024-09-16T16:54:43.869032+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:43.869032+0000","last_undegraded":"2024-09-16T16:54:43.869032+0000","last_fullsized":"2024-09-16T16:54:43.869032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'527","reported_seq":548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.674741+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:43.674741+0000","last_peered":"2024-09-16T16:54:43.674741+0000","last_clean":"2024-09-16T16:54:43.674741+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:43.674741+0000","last_undegraded":"2024-09-16T16:54:43.674741+0000","last_fullsized":"2024-09-16T16:54:43.674741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34537472,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'517","reported_seq":538,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.676193+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:43.676193+0000","last_peered":"2024-09-16T16:54:43.676193+0000","last_clean":"2024-09-16T16:54:43.676193+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:43.676193+0000","last_undegraded":"2024-09-16T16:54:43.676193+0000","last_fullsized":"2024-09-16T16:54:43.676193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'529","reported_seq":550,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.316925+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:43.316925+0000","last_peered":"2024-09-16T16:54:43.316925+0000","last_clean":"2024-09-16T16:54:43.316925+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:43.316925+0000","last_undegraded":"2024-09-16T16:54:43.316925+0000","last_fullsized":"2024-09-16T16:54:43.316925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'520","reported_seq":541,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.313571+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:43.313571+0000","last_peered":"2024-09-16T16:54:43.313571+0000","last_clean":"2024-09-16T16:54:43.313571+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:43.313571+0000","last_undegraded":"2024-09-16T16:54:43.313571+0000","last_fullsized":"2024-09-16T16:54:43.313571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":571408384,"num_objects":8719,"num_object_clones":0,"num_object_copies":26157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8719,"num_write_kb":558016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8719,"ondisk_log_size":8719,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":770108,"kb_used_data":770108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51527620,"statfs":{"total":53552873472,"available":52764282880,"internally_reserved":0,"allocated":788590592,"data_stored":788590592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":987308,"kb_used_data":987308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51310420,"statfs":{"total":53552873472,"available":52541870080,"internally_reserved":0,"allocated":1011003392,"data_stored":1011003392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":693840,"kb_used_data":693840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51603888,"statfs":{"total":53552873472,"available":52842381312,"internally_reserved":0,"allocated":710492160,"data_stored":710492160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":915756,"kb_used_data":915756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51381972,"statfs":{"total":53552873472,"available":52615139328,"internally_reserved":0,"allocated":937734144,"data_stored":937734144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:03.973 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:55:03.973 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:03.973 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:03.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:04.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.120+0000 7f80de074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.132+0000 7f80de074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:04.175 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:04.176 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:04.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:04.179 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:04.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:04.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.321+0000 7fbbf5511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.335+0000 7fbbf5511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:04.353 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:04.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:04.358 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:04.359 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:04.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.495+0000 7f7b3da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.508+0000 7f7b3da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:04.554 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:04.555 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:04.559 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:04.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:04.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:04.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.719+0000 7f08a7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:04.732+0000 7f08a7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:04.757 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:04.758 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:04.762 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:04.762 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:04.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:05.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:05.043+0000 7fb8c2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:05.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:05.053+0000 7fb8c2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:07.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:07.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:07.567+0000 7fb306d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:07.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:07.575+0000 7fb306d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:09.763 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:09.763 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:09.763 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:09.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:09.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:09.927+0000 7fa38fcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:09.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:09.939+0000 7fa38fcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:10.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:10.010+0000 7fd4fbb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:10.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:10.020+0000 7fd4fa8ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:10.274 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:10.275 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:10.297 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-16T16:55:09.862400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":571998771,"num_objects":8723,"num_object_clones":0,"num_object_copies":26169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8800,"num_write_kb":559124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8774,"ondisk_log_size":8774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3367012,"kb_used_data":3367012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205823900,"statfs":{"total":214211493888,"available":210763673600,"internally_reserved":0,"allocated":3447820288,"data_stored":3447820288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001519"},"pg_stats":[{"pgid":"5.f","version":"50'584","reported_seq":605,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.246000+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:43.246000+0000","last_peered":"2024-09-16T16:54:43.246000+0000","last_clean":"2024-09-16T16:54:43.246000+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:43.246000+0000","last_undegraded":"2024-09-16T16:54:43.246000+0000","last_fullsized":"2024-09-16T16:54:43.246000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"50'571","reported_seq":592,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.763785+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:54:43.763785+0000","last_peered":"2024-09-16T16:54:43.763785+0000","last_clean":"2024-09-16T16:54:43.763785+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:54:43.763785+0000","last_undegraded":"2024-09-16T16:54:43.763785+0000","last_fullsized":"2024-09-16T16:54:43.763785+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37421056,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":571,"num_write_kb":36544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"50'528","reported_seq":549,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.553797+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:54:43.553797+0000","last_peered":"2024-09-16T16:54:43.553797+0000","last_clean":"2024-09-16T16:54:43.553797+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:54:43.553797+0000","last_undegraded":"2024-09-16T16:54:43.553797+0000","last_fullsized":"2024-09-16T16:54:43.553797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'525","reported_seq":546,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.671837+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:43.671837+0000","last_peered":"2024-09-16T16:54:43.671837+0000","last_clean":"2024-09-16T16:54:43.671837+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:43.671837+0000","last_undegraded":"2024-09-16T16:54:43.671837+0000","last_fullsized":"2024-09-16T16:54:43.671837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"50'545","reported_seq":566,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.552760+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:54:43.552760+0000","last_peered":"2024-09-16T16:54:43.552760+0000","last_clean":"2024-09-16T16:54:43.552760+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:54:43.552760+0000","last_undegraded":"2024-09-16T16:54:43.552760+0000","last_fullsized":"2024-09-16T16:54:43.552760+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'555","reported_seq":576,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.343544+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:43.343544+0000","last_peered":"2024-09-16T16:54:43.343544+0000","last_clean":"2024-09-16T16:54:43.343544+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:43.343544+0000","last_undegraded":"2024-09-16T16:54:43.343544+0000","last_fullsized":"2024-09-16T16:54:43.343544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"50'534","reported_seq":555,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.540898+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:54:43.540898+0000","last_peered":"2024-09-16T16:54:43.540898+0000","last_clean":"2024-09-16T16:54:43.540898+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:54:43.540898+0000","last_undegraded":"2024-09-16T16:54:43.540898+0000","last_fullsized":"2024-09-16T16:54:43.540898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34996224,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":34176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"50'540","reported_seq":561,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.622360+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:54:43.622360+0000","last_peered":"2024-09-16T16:54:43.622360+0000","last_clean":"2024-09-16T16:54:43.622360+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:54:43.622360+0000","last_undegraded":"2024-09-16T16:54:43.622360+0000","last_fullsized":"2024-09-16T16:54:43.622360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'553","reported_seq":574,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.865157+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:43.865157+0000","last_peered":"2024-09-16T16:54:43.865157+0000","last_clean":"2024-09-16T16:54:43.865157+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:43.865157+0000","last_undegraded":"2024-09-16T16:54:43.865157+0000","last_fullsized":"2024-09-16T16:54:43.865157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.809539+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:53:20.809539+0000","last_peered":"2024-09-16T16:53:20.809539+0000","last_clean":"2024-09-16T16:53:20.809539+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:53:20.809539+0000","last_undegraded":"2024-09-16T16:53:20.809539+0000","last_fullsized":"2024-09-16T16:53:20.809539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"50'581","reported_seq":602,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.720806+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:54:43.720806+0000","last_peered":"2024-09-16T16:54:43.720806+0000","last_clean":"2024-09-16T16:54:43.720806+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:54:43.720806+0000","last_undegraded":"2024-09-16T16:54:43.720806+0000","last_fullsized":"2024-09-16T16:54:43.720806+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38076416,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":581,"num_write_kb":37184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.775500+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:53:20.775500+0000","last_peered":"2024-09-16T16:53:20.775500+0000","last_clean":"2024-09-16T16:53:20.775500+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:53:20.775500+0000","last_undegraded":"2024-09-16T16:53:20.775500+0000","last_fullsized":"2024-09-16T16:53:20.775500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'548","reported_seq":569,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.487481+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:43.487481+0000","last_peered":"2024-09-16T16:54:43.487481+0000","last_clean":"2024-09-16T16:54:43.487481+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:43.487481+0000","last_undegraded":"2024-09-16T16:54:43.487481+0000","last_fullsized":"2024-09-16T16:54:43.487481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.805698+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:53:20.805698+0000","last_peered":"2024-09-16T16:53:20.805698+0000","last_clean":"2024-09-16T16:53:20.805698+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:53:20.805698+0000","last_undegraded":"2024-09-16T16:53:20.805698+0000","last_fullsized":"2024-09-16T16:53:20.805698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'562","reported_seq":583,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.869032+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:43.869032+0000","last_peered":"2024-09-16T16:54:43.869032+0000","last_clean":"2024-09-16T16:54:43.869032+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:43.869032+0000","last_undegraded":"2024-09-16T16:54:43.869032+0000","last_fullsized":"2024-09-16T16:54:43.869032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.777128+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:53:20.777128+0000","last_peered":"2024-09-16T16:53:20.777128+0000","last_clean":"2024-09-16T16:53:20.777128+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:53:20.777128+0000","last_undegraded":"2024-09-16T16:53:20.777128+0000","last_fullsized":"2024-09-16T16:53:20.777128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'527","reported_seq":548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.674741+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:43.674741+0000","last_peered":"2024-09-16T16:54:43.674741+0000","last_clean":"2024-09-16T16:54:43.674741+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:43.674741+0000","last_undegraded":"2024-09-16T16:54:43.674741+0000","last_fullsized":"2024-09-16T16:54:43.674741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34537472,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"50'517","reported_seq":538,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.676193+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:54:43.676193+0000","last_peered":"2024-09-16T16:54:43.676193+0000","last_clean":"2024-09-16T16:54:43.676193+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:54:43.676193+0000","last_undegraded":"2024-09-16T16:54:43.676193+0000","last_fullsized":"2024-09-16T16:54:43.676193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'529","reported_seq":550,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.316925+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:43.316925+0000","last_peered":"2024-09-16T16:54:43.316925+0000","last_clean":"2024-09-16T16:54:43.316925+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:43.316925+0000","last_undegraded":"2024-09-16T16:54:43.316925+0000","last_fullsized":"2024-09-16T16:54:43.316925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"50'520","reported_seq":541,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.313571+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:54:43.313571+0000","last_peered":"2024-09-16T16:54:43.313571+0000","last_clean":"2024-09-16T16:54:43.313571+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:54:43.313571+0000","last_undegraded":"2024-09-16T16:54:43.313571+0000","last_fullsized":"2024-09-16T16:54:43.313571+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.810816+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:53:20.810816+0000","last_peered":"2024-09-16T16:53:20.810816+0000","last_clean":"2024-09-16T16:53:20.810816+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:53:20.810816+0000","last_undegraded":"2024-09-16T16:53:20.810816+0000","last_fullsized":"2024-09-16T16:53:20.810816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":571408384,"num_objects":8719,"num_object_clones":0,"num_object_copies":26157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8719,"num_write_kb":558016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8719,"ondisk_log_size":8719,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210747781120,"internally_reserved":0,"allocated":3463712768,"data_stored":3463712768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":770108,"kb_used_data":770108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51527620,"statfs":{"total":53552873472,"available":52764282880,"internally_reserved":0,"allocated":788590592,"data_stored":788590592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":987308,"kb_used_data":987308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51310420,"statfs":{"total":53552873472,"available":52541870080,"internally_reserved":0,"allocated":1011003392,"data_stored":1011003392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":693840,"kb_used_data":693840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51603888,"statfs":{"total":53552873472,"available":52842381312,"internally_reserved":0,"allocated":710492160,"data_stored":710492160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":915756,"kb_used_data":915756,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51381972,"statfs":{"total":53552873472,"available":52615139328,"internally_reserved":0,"allocated":937734144,"data_stored":937734144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52612648960,"internally_reserved":0,"allocated":940224512,"data_stored":940224512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":52838588416,"internally_reserved":0,"allocated":714285056,"data_stored":714285056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:12.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:12.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:12.389+0000 7fc65b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:12.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:12.397+0000 7fc65b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:14.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:14.863+0000 7f5257663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:14.871+0000 7f5257663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:15.299 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:15.299 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:15.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:15.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:15.439+0000 7f9037391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:15.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:15.449+0000 7f9037391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:15.742 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:15.743 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:15.766 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-16T16:55:13.863274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":490537547,"num_objects":7481,"num_object_clones":0,"num_object_copies":22443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10460,"num_write_kb":572437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10434,"ondisk_log_size":10434,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2917828,"kb_used_data":2917828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206273084,"statfs":{"total":214211493888,"available":211223638016,"internally_reserved":0,"allocated":2987855872,"data_stored":2987855872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-81461224,"num_objects":-1242,"num_object_clones":0,"num_object_copies":-3726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1660,"num_write_kb":13313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.927601"},"pg_stats":[{"pgid":"5.f","version":"50'584","reported_seq":605,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.246000+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:54:43.246000+0000","last_peered":"2024-09-16T16:54:43.246000+0000","last_clean":"2024-09-16T16:54:43.246000+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:54:43.246000+0000","last_undegraded":"2024-09-16T16:54:43.246000+0000","last_fullsized":"2024-09-16T16:54:43.246000+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"54'797","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.478804+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:55:13.478804+0000","last_peered":"2024-09-16T16:55:13.478804+0000","last_clean":"2024-09-16T16:55:13.478804+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:55:13.478804+0000","last_undegraded":"2024-09-16T16:55:13.478804+0000","last_fullsized":"2024-09-16T16:55:13.478804+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"54'741","reported_seq":775,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.710861+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:55:13.710861+0000","last_peered":"2024-09-16T16:55:13.710861+0000","last_clean":"2024-09-16T16:55:13.710861+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:55:13.710861+0000","last_undegraded":"2024-09-16T16:55:13.710861+0000","last_fullsized":"2024-09-16T16:55:13.710861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117272,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":741,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"50'525","reported_seq":546,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.671837+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:54:43.671837+0000","last_peered":"2024-09-16T16:54:43.671837+0000","last_clean":"2024-09-16T16:54:43.671837+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:54:43.671837+0000","last_undegraded":"2024-09-16T16:54:43.671837+0000","last_fullsized":"2024-09-16T16:54:43.671837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'749","reported_seq":782,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.650943+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:55:13.650943+0000","last_peered":"2024-09-16T16:55:13.650943+0000","last_clean":"2024-09-16T16:55:13.650943+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:55:13.650943+0000","last_undegraded":"2024-09-16T16:55:13.650943+0000","last_fullsized":"2024-09-16T16:55:13.650943+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"50'555","reported_seq":576,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.343544+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:54:43.343544+0000","last_peered":"2024-09-16T16:54:43.343544+0000","last_clean":"2024-09-16T16:54:43.343544+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:54:43.343544+0000","last_undegraded":"2024-09-16T16:54:43.343544+0000","last_fullsized":"2024-09-16T16:54:43.343544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36372480,"num_objects":555,"num_object_clones":0,"num_object_copies":1665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":555,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"54'750","reported_seq":783,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.691049+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:55:13.691049+0000","last_peered":"2024-09-16T16:55:13.691049+0000","last_clean":"2024-09-16T16:55:13.691049+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:55:13.691049+0000","last_undegraded":"2024-09-16T16:55:13.691049+0000","last_fullsized":"2024-09-16T16:55:13.691049+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"54'738","reported_seq":771,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.610993+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:55:13.610993+0000","last_peered":"2024-09-16T16:55:13.610993+0000","last_clean":"2024-09-16T16:55:13.610993+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:55:13.610993+0000","last_undegraded":"2024-09-16T16:55:13.610993+0000","last_fullsized":"2024-09-16T16:55:13.610993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"50'553","reported_seq":574,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.865157+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:54:43.865157+0000","last_peered":"2024-09-16T16:54:43.865157+0000","last_clean":"2024-09-16T16:54:43.865157+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:54:43.865157+0000","last_undegraded":"2024-09-16T16:54:43.865157+0000","last_fullsized":"2024-09-16T16:54:43.865157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":190,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.765740+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:53:20.765740+0000","last_peered":"2024-09-16T16:53:20.765740+0000","last_clean":"2024-09-16T16:53:20.765740+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:53:20.765740+0000","last_undegraded":"2024-09-16T16:53:20.765740+0000","last_fullsized":"2024-09-16T16:53:20.765740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'795","reported_seq":828,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.711194+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:55:13.711194+0000","last_peered":"2024-09-16T16:55:13.711194+0000","last_clean":"2024-09-16T16:55:13.711194+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:55:13.711194+0000","last_undegraded":"2024-09-16T16:55:13.711194+0000","last_fullsized":"2024-09-16T16:55:13.711194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"50'548","reported_seq":569,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.487481+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:54:43.487481+0000","last_peered":"2024-09-16T16:54:43.487481+0000","last_clean":"2024-09-16T16:54:43.487481+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:54:43.487481+0000","last_undegraded":"2024-09-16T16:54:43.487481+0000","last_fullsized":"2024-09-16T16:54:43.487481+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"50'562","reported_seq":583,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.869032+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:54:43.869032+0000","last_peered":"2024-09-16T16:54:43.869032+0000","last_clean":"2024-09-16T16:54:43.869032+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:54:43.869032+0000","last_undegraded":"2024-09-16T16:54:43.869032+0000","last_fullsized":"2024-09-16T16:54:43.869032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"50'527","reported_seq":548,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.674741+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:54:43.674741+0000","last_peered":"2024-09-16T16:54:43.674741+0000","last_clean":"2024-09-16T16:54:43.674741+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:54:43.674741+0000","last_undegraded":"2024-09-16T16:54:43.674741+0000","last_fullsized":"2024-09-16T16:54:43.674741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34537472,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":527,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.883812+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:53:20.883812+0000","last_peered":"2024-09-16T16:53:20.883812+0000","last_clean":"2024-09-16T16:53:20.883812+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:53:20.883812+0000","last_undegraded":"2024-09-16T16:53:20.883812+0000","last_fullsized":"2024-09-16T16:53:20.883812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"54'706","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.503253+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:55:13.503253+0000","last_peered":"2024-09-16T16:55:13.503253+0000","last_clean":"2024-09-16T16:55:13.503253+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:55:13.503253+0000","last_undegraded":"2024-09-16T16:55:13.503253+0000","last_fullsized":"2024-09-16T16:55:13.503253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":706,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.772113+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:53:20.772113+0000","last_peered":"2024-09-16T16:53:20.772113+0000","last_clean":"2024-09-16T16:53:20.772113+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:53:20.772113+0000","last_undegraded":"2024-09-16T16:53:20.772113+0000","last_fullsized":"2024-09-16T16:53:20.772113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"50'529","reported_seq":550,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:54:43.316925+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:54:43.316925+0000","last_peered":"2024-09-16T16:54:43.316925+0000","last_clean":"2024-09-16T16:54:43.316925+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:54:43.316925+0000","last_undegraded":"2024-09-16T16:54:43.316925+0000","last_fullsized":"2024-09-16T16:54:43.316925+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T16:53:20.879911+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:53:20.879911+0000","last_peered":"2024-09-16T16:53:20.879911+0000","last_clean":"2024-09-16T16:53:20.879911+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:53:20.879911+0000","last_undegraded":"2024-09-16T16:53:20.879911+0000","last_fullsized":"2024-09-16T16:53:20.879911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"54'720","reported_seq":753,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.668212+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:55:13.668212+0000","last_peered":"2024-09-16T16:55:13.668212+0000","last_clean":"2024-09-16T16:55:13.668212+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:55:13.668212+0000","last_undegraded":"2024-09-16T16:55:13.668212+0000","last_fullsized":"2024-09-16T16:55:13.668212+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":489947160,"num_objects":7477,"num_object_clones":0,"num_object_copies":22431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10379,"num_write_kb":571329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211221258240,"internally_reserved":0,"allocated":2990235648,"data_stored":2990235648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10379,"ondisk_log_size":10379,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211221258240,"internally_reserved":0,"allocated":2990235648,"data_stored":2990235648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":770108,"kb_used_data":770108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51527620,"statfs":{"total":53552873472,"available":52764282880,"internally_reserved":0,"allocated":788590592,"data_stored":788590592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":987308,"kb_used_data":987308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51310420,"statfs":{"total":53552873472,"available":52541870080,"internally_reserved":0,"allocated":1011003392,"data_stored":1011003392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506616,"kb_used_data":506616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51791112,"statfs":{"total":53552873472,"available":53034098688,"internally_reserved":0,"allocated":518774784,"data_stored":518774784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":653796,"kb_used_data":653796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51643932,"statfs":{"total":53552873472,"available":52883386368,"internally_reserved":0,"allocated":669487104,"data_stored":669487104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52885889024,"internally_reserved":0,"allocated":666984448,"data_stored":666984448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53038825472,"internally_reserved":0,"allocated":514048000,"data_stored":514048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52885889024,"internally_reserved":0,"allocated":666984448,"data_stored":666984448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53038825472,"internally_reserved":0,"allocated":514048000,"data_stored":514048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52537671680,"internally_reserved":0,"allocated":1015201792,"data_stored":1015201792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52758872064,"internally_reserved":0,"allocated":794001408,"data_stored":794001408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:17.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:17.406+0000 7f5072191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:17.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:17.414+0000 7f5072191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:19.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:19.794+0000 7f8988591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:19.803+0000 7f8988591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:20.768 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:20.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:20.768 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:20.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:20.886+0000 7fad76d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:20.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:20.897+0000 7fad76d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:20.926 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:20.926 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:20.927 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:20.930 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:20.930 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:20.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:21.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.048+0000 7f9197791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.059+0000 7f9197791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:21.078 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:21.079 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:21.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:21.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:21.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:21.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.218+0000 7fdc7bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.233+0000 7fdc7bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:21.303 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:21.304 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:21.307 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:21.307 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:21.308 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:21.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.463+0000 7f1266063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:21.477+0000 7f1266063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:21.499 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:21.500 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:21.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:21.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:22.219 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:22.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:22.352+0000 7f85c6e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:22.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:22.358+0000 7f85c6e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:24.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:24.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:24.708+0000 7f6ffe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:24.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:24.719+0000 7f6ffe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.505 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:26.505 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:26.505 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:26.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:26.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:26.642+0000 7f686d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:26.657+0000 7f686d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:26.698 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:26.699 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:26.702 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:26.703 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:26.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:26.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:26.869+0000 7f0061391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:26.883+0000 7f0061391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.913 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:26.914 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:26.918 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:26.918 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:26.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:26.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:27.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.051+0000 7f0ff06a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.063+0000 7f0ff06a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.137+0000 7f4d9c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.145+0000 7f4d9c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:27.176 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:27.176 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:27.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:27.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.344+0000 7f733507f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:27.357+0000 7f733507f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:27.386 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:27.387 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:27.388 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:27.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:27.392 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:29.443 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:29.583+0000 7fb586791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:29.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:29.594+0000 7fb586791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:31.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:31.983+0000 7fd702951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:31.993+0000 7fd702951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:32.393 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:32.393 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:32.394 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:32.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:32.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:32.576+0000 7f653f8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:32.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:32.593+0000 7f653f8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:32.633 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:32.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:32.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:32.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:32.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:32.822+0000 7f6db5697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:32.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:32.838+0000 7f6db5697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:32.905 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:32.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:32.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:32.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:32.906 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:32.906 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:32.911 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:32.911 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:32.911 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:33.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:33.060+0000 7f89538ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:33.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:33.075+0000 7f89538ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:33.152 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:33.155 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:33.156 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:33.156 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:33.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:33.310+0000 7fa4f0e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:33.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:33.329+0000 7fa4f0e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:33.350 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:33.353 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:33.353 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:34.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:34.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:34.543+0000 7f9c41cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:34.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:34.552+0000 7f9c41cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:36.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:36.986+0000 7fa888748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:36.993+0000 7fa888748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:38.354 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:38.355 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:38.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:38.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:38.491+0000 7f8eef591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:38.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:38.505+0000 7f8eef591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:38.763 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:38.763 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:38.787 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-16T16:55:37.868286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":403636811,"num_objects":6155,"num_object_clones":0,"num_object_copies":18465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12202,"num_write_kb":585749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12176,"ondisk_log_size":12176,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2424924,"kb_used_data":2424924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206765988,"statfs":{"total":214211493888,"available":211728371712,"internally_reserved":0,"allocated":2483122176,"data_stored":2483122176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002384"},"pg_stats":[{"pgid":"5.f","version":"54'804","reported_seq":837,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.696394+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:55:13.696394+0000","last_peered":"2024-09-16T16:55:13.696394+0000","last_clean":"2024-09-16T16:55:13.696394+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:55:13.696394+0000","last_undegraded":"2024-09-16T16:55:13.696394+0000","last_fullsized":"2024-09-16T16:55:13.696394+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"54'797","reported_seq":830,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.478804+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:55:13.478804+0000","last_peered":"2024-09-16T16:55:13.478804+0000","last_clean":"2024-09-16T16:55:13.478804+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:55:13.478804+0000","last_undegraded":"2024-09-16T16:55:13.478804+0000","last_fullsized":"2024-09-16T16:55:13.478804+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"54'741","reported_seq":775,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.710861+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:55:13.710861+0000","last_peered":"2024-09-16T16:55:13.710861+0000","last_clean":"2024-09-16T16:55:13.710861+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:55:13.710861+0000","last_undegraded":"2024-09-16T16:55:13.710861+0000","last_fullsized":"2024-09-16T16:55:13.710861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117272,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":741,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'732","reported_seq":765,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.695211+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:55:13.695211+0000","last_peered":"2024-09-16T16:55:13.695211+0000","last_clean":"2024-09-16T16:55:13.695211+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:55:13.695211+0000","last_undegraded":"2024-09-16T16:55:13.695211+0000","last_fullsized":"2024-09-16T16:55:13.695211+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'749","reported_seq":782,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.650943+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:55:13.650943+0000","last_peered":"2024-09-16T16:55:13.650943+0000","last_clean":"2024-09-16T16:55:13.650943+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:55:13.650943+0000","last_undegraded":"2024-09-16T16:55:13.650943+0000","last_fullsized":"2024-09-16T16:55:13.650943+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":749,"log_dups_size":0,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"54'765","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.821091+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:55:13.821091+0000","last_peered":"2024-09-16T16:55:13.821091+0000","last_clean":"2024-09-16T16:55:13.821091+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:55:13.821091+0000","last_undegraded":"2024-09-16T16:55:13.821091+0000","last_fullsized":"2024-09-16T16:55:13.821091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25231360,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"54'750","reported_seq":783,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.691049+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:55:13.691049+0000","last_peered":"2024-09-16T16:55:13.691049+0000","last_clean":"2024-09-16T16:55:13.691049+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:55:13.691049+0000","last_undegraded":"2024-09-16T16:55:13.691049+0000","last_fullsized":"2024-09-16T16:55:13.691049+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"54'738","reported_seq":771,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.610993+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:55:13.610993+0000","last_peered":"2024-09-16T16:55:13.610993+0000","last_clean":"2024-09-16T16:55:13.610993+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:55:13.610993+0000","last_undegraded":"2024-09-16T16:55:13.610993+0000","last_fullsized":"2024-09-16T16:55:13.610993+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"54'765","reported_seq":798,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.558268+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:55:13.558268+0000","last_peered":"2024-09-16T16:55:13.558268+0000","last_clean":"2024-09-16T16:55:13.558268+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:55:13.558268+0000","last_undegraded":"2024-09-16T16:55:13.558268+0000","last_fullsized":"2024-09-16T16:55:13.558268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":36480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.981690+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:55:02.981690+0000","last_peered":"2024-09-16T16:55:02.981690+0000","last_clean":"2024-09-16T16:55:02.981690+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:55:02.981690+0000","last_undegraded":"2024-09-16T16:55:02.981690+0000","last_fullsized":"2024-09-16T16:55:02.981690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'795","reported_seq":828,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.711194+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:55:13.711194+0000","last_peered":"2024-09-16T16:55:13.711194+0000","last_clean":"2024-09-16T16:55:13.711194+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:55:13.711194+0000","last_undegraded":"2024-09-16T16:55:13.711194+0000","last_fullsized":"2024-09-16T16:55:13.711194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"54'787","reported_seq":820,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.837231+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:55:13.837231+0000","last_peered":"2024-09-16T16:55:13.837231+0000","last_clean":"2024-09-16T16:55:13.837231+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:55:13.837231+0000","last_undegraded":"2024-09-16T16:55:13.837231+0000","last_fullsized":"2024-09-16T16:55:13.837231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'773","reported_seq":806,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.793975+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:55:13.793975+0000","last_peered":"2024-09-16T16:55:13.793975+0000","last_clean":"2024-09-16T16:55:13.793975+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:55:13.793975+0000","last_undegraded":"2024-09-16T16:55:13.793975+0000","last_fullsized":"2024-09-16T16:55:13.793975+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'743","reported_seq":776,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.630438+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:55:13.630438+0000","last_peered":"2024-09-16T16:55:13.630438+0000","last_clean":"2024-09-16T16:55:13.630438+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:55:13.630438+0000","last_undegraded":"2024-09-16T16:55:13.630438+0000","last_fullsized":"2024-09-16T16:55:13.630438+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.992103+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:55:02.992103+0000","last_peered":"2024-09-16T16:55:02.992103+0000","last_clean":"2024-09-16T16:55:02.992103+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:55:02.992103+0000","last_undegraded":"2024-09-16T16:55:02.992103+0000","last_fullsized":"2024-09-16T16:55:02.992103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"54'706","reported_seq":739,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.503253+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:55:13.503253+0000","last_peered":"2024-09-16T16:55:13.503253+0000","last_clean":"2024-09-16T16:55:13.503253+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:55:13.503253+0000","last_undegraded":"2024-09-16T16:55:13.503253+0000","last_fullsized":"2024-09-16T16:55:13.503253+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":706,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.988065+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:55:02.988065+0000","last_peered":"2024-09-16T16:55:02.988065+0000","last_clean":"2024-09-16T16:55:02.988065+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:55:02.988065+0000","last_undegraded":"2024-09-16T16:55:02.988065+0000","last_fullsized":"2024-09-16T16:55:02.988065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"54'756","reported_seq":789,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.571953+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:55:13.571953+0000","last_peered":"2024-09-16T16:55:13.571953+0000","last_clean":"2024-09-16T16:55:13.571953+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:55:13.571953+0000","last_undegraded":"2024-09-16T16:55:13.571953+0000","last_fullsized":"2024-09-16T16:55:13.571953+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.982776+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:55:02.982776+0000","last_peered":"2024-09-16T16:55:02.982776+0000","last_clean":"2024-09-16T16:55:02.982776+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:55:02.982776+0000","last_undegraded":"2024-09-16T16:55:02.982776+0000","last_fullsized":"2024-09-16T16:55:02.982776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"54'720","reported_seq":753,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:13.668212+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:55:13.668212+0000","last_peered":"2024-09-16T16:55:13.668212+0000","last_clean":"2024-09-16T16:55:13.668212+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:55:13.668212+0000","last_undegraded":"2024-09-16T16:55:13.668212+0000","last_fullsized":"2024-09-16T16:55:13.668212+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":403046424,"num_objects":6151,"num_object_clones":0,"num_object_copies":18453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12121,"num_write_kb":584641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211746963456,"internally_reserved":0,"allocated":2464530432,"data_stored":2464530432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12121,"ondisk_log_size":12121,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211746701312,"internally_reserved":0,"allocated":2464792576,"data_stored":2464792576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52986253312,"internally_reserved":0,"allocated":566620160,"data_stored":566620160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":559308,"kb_used_data":559308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51738420,"statfs":{"total":53552873472,"available":52980142080,"internally_reserved":0,"allocated":572731392,"data_stored":572731392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":705204,"kb_used_data":705204,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51592524,"statfs":{"total":53552873472,"available":52830744576,"internally_reserved":0,"allocated":722128896,"data_stored":722128896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":506616,"kb_used_data":506616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51791112,"statfs":{"total":53552873472,"available":53034098688,"internally_reserved":0,"allocated":518774784,"data_stored":518774784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":653796,"kb_used_data":653796,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51643932,"statfs":{"total":53552873472,"available":52883386368,"internally_reserved":0,"allocated":669487104,"data_stored":669487104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52986253312,"internally_reserved":0,"allocated":566620160,"data_stored":566620160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52885889024,"internally_reserved":0,"allocated":666984448,"data_stored":666984448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53038825472,"internally_reserved":0,"allocated":514048000,"data_stored":514048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52835598336,"internally_reserved":0,"allocated":717275136,"data_stored":717275136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52986388480,"internally_reserved":0,"allocated":566484992,"data_stored":566484992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":52885889024,"internally_reserved":0,"allocated":666984448,"data_stored":666984448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53038825472,"internally_reserved":0,"allocated":514048000,"data_stored":514048000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":52835729408,"internally_reserved":0,"allocated":717144064,"data_stored":717144064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":52986519552,"internally_reserved":0,"allocated":566353920,"data_stored":566353920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:39.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:39.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:39.428+0000 7fc2ddf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:39.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:39.438+0000 7fc2dcd2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:41.663 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:41.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:41.786+0000 7f0346391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:41.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:41.793+0000 7f0346391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:43.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:43.790 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:43.790 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:43.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:43.923+0000 7fe51e6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:43.934+0000 7fe51e6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.957 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:43.957 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:43.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:43.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:43.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:44.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:44.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.106+0000 7fcfb5b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.120+0000 7fcfb5b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:44.207 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:44.207 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:44.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:44.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.226+0000 7f212e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.233+0000 7f212e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.366+0000 7ff318191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.378+0000 7ff318191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:44.409 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:44.410 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:44.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:44.414 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:44.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.599+0000 7ff34bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:44.609+0000 7ff34bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:44.630 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:44.630 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:44.630 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:44.632 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:44.632 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:46.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:46.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:46.644+0000 7fa6240fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:46.650+0000 7fa6240fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:48.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:48.976+0000 7fb0df351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:48.982+0000 7fb0df351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.633 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:49.633 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:49.633 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:49.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:49.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:49.775+0000 7fe9b8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:49.789+0000 7fe9b8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:49.813 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:49.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:49.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:49.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:49.965+0000 7ff601b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:49.982+0000 7ff601b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:50.007 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:50.008 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:50.013 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:50.014 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:50.014 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:50.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:50.139+0000 7fda10f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:50.152+0000 7fda10f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.203 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:50.204 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:50.205 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:50.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:50.209 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:50.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:50.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:50.372+0000 7fb41bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:50.384+0000 7fb41bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:55:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:55:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:55:50.485 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:55:50.488 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:50.488 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:51.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:51.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:51.345+0000 7f0a79474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:51.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:51.355+0000 7f0a79474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:53.642 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:53.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:53.787+0000 7f9ec8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:53.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:53.795+0000 7f9ec8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:55.489 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:55.489 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:55.489 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:55.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:55.639+0000 7f9582711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:55.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:55.653+0000 7f9582711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:55.949 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:55:55.949 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:55:55.973 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-16T16:55:55.872041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202900043,"num_objects":3092,"num_object_clones":0,"num_object_copies":9276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15265,"num_write_kb":585749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15239,"ondisk_log_size":15239,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1239040,"kb_used_data":1239040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207951872,"statfs":{"total":214211493888,"available":212942716928,"internally_reserved":0,"allocated":1268776960,"data_stored":1268776960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-99680256,"num_objects":-1521,"num_object_clones":0,"num_object_copies":-4563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1521,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002466"},"pg_stats":[{"pgid":"5.f","version":"54'1011","reported_seq":1044,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.128187+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:55:43.128187+0000","last_peered":"2024-09-16T16:55:43.128187+0000","last_clean":"2024-09-16T16:55:43.128187+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:55:43.128187+0000","last_undegraded":"2024-09-16T16:55:43.128187+0000","last_fullsized":"2024-09-16T16:55:43.128187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"54'999","reported_seq":1032,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:42.882851+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:55:42.882851+0000","last_peered":"2024-09-16T16:55:42.882851+0000","last_clean":"2024-09-16T16:55:42.882851+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:55:42.882851+0000","last_undegraded":"2024-09-16T16:55:42.882851+0000","last_fullsized":"2024-09-16T16:55:42.882851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"54'932","reported_seq":966,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.524875+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:55:43.524875+0000","last_peered":"2024-09-16T16:55:43.524875+0000","last_clean":"2024-09-16T16:55:43.524875+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:55:43.524875+0000","last_undegraded":"2024-09-16T16:55:43.524875+0000","last_fullsized":"2024-09-16T16:55:43.524875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599896,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":932,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'927","reported_seq":960,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.291443+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:55:43.291443+0000","last_peered":"2024-09-16T16:55:43.291443+0000","last_clean":"2024-09-16T16:55:43.291443+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:55:43.291443+0000","last_undegraded":"2024-09-16T16:55:43.291443+0000","last_fullsized":"2024-09-16T16:55:43.291443+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'944","reported_seq":977,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.568198+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:55:43.568198+0000","last_peered":"2024-09-16T16:55:43.568198+0000","last_clean":"2024-09-16T16:55:43.568198+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:55:43.568198+0000","last_undegraded":"2024-09-16T16:55:43.568198+0000","last_fullsized":"2024-09-16T16:55:43.568198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"54'949","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.340085+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:55:43.340085+0000","last_peered":"2024-09-16T16:55:43.340085+0000","last_clean":"2024-09-16T16:55:43.340085+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:55:43.340085+0000","last_undegraded":"2024-09-16T16:55:43.340085+0000","last_fullsized":"2024-09-16T16:55:43.340085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"54'923","reported_seq":956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:42.805377+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:55:42.805377+0000","last_peered":"2024-09-16T16:55:42.805377+0000","last_clean":"2024-09-16T16:55:42.805377+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:55:42.805377+0000","last_undegraded":"2024-09-16T16:55:42.805377+0000","last_fullsized":"2024-09-16T16:55:42.805377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"54'932","reported_seq":965,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.770815+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:55:43.770815+0000","last_peered":"2024-09-16T16:55:43.770815+0000","last_clean":"2024-09-16T16:55:43.770815+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:55:43.770815+0000","last_undegraded":"2024-09-16T16:55:43.770815+0000","last_fullsized":"2024-09-16T16:55:43.770815+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":932,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"54'950","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.231766+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:55:43.231766+0000","last_peered":"2024-09-16T16:55:43.231766+0000","last_clean":"2024-09-16T16:55:43.231766+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:55:43.231766+0000","last_undegraded":"2024-09-16T16:55:43.231766+0000","last_fullsized":"2024-09-16T16:55:43.231766+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":950,"num_write_kb":36480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.981690+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:55:02.981690+0000","last_peered":"2024-09-16T16:55:02.981690+0000","last_clean":"2024-09-16T16:55:02.981690+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:55:02.981690+0000","last_undegraded":"2024-09-16T16:55:02.981690+0000","last_fullsized":"2024-09-16T16:55:02.981690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'1010","reported_seq":1043,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.708539+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:55:43.708539+0000","last_peered":"2024-09-16T16:55:43.708539+0000","last_clean":"2024-09-16T16:55:43.708539+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:55:43.708539+0000","last_undegraded":"2024-09-16T16:55:43.708539+0000","last_fullsized":"2024-09-16T16:55:43.708539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"54'954","reported_seq":987,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.846769+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:55:43.846769+0000","last_peered":"2024-09-16T16:55:43.846769+0000","last_clean":"2024-09-16T16:55:43.846769+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:55:43.846769+0000","last_undegraded":"2024-09-16T16:55:43.846769+0000","last_fullsized":"2024-09-16T16:55:43.846769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'974","reported_seq":1007,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.551820+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:55:43.551820+0000","last_peered":"2024-09-16T16:55:43.551820+0000","last_clean":"2024-09-16T16:55:43.551820+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:55:43.551820+0000","last_undegraded":"2024-09-16T16:55:43.551820+0000","last_fullsized":"2024-09-16T16:55:43.551820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'946","reported_seq":979,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.606051+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:55:43.606051+0000","last_peered":"2024-09-16T16:55:43.606051+0000","last_clean":"2024-09-16T16:55:43.606051+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:55:43.606051+0000","last_undegraded":"2024-09-16T16:55:43.606051+0000","last_fullsized":"2024-09-16T16:55:43.606051+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.992103+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:55:02.992103+0000","last_peered":"2024-09-16T16:55:02.992103+0000","last_clean":"2024-09-16T16:55:02.992103+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:55:02.992103+0000","last_undegraded":"2024-09-16T16:55:02.992103+0000","last_fullsized":"2024-09-16T16:55:02.992103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"54'885","reported_seq":918,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.620171+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:55:43.620171+0000","last_peered":"2024-09-16T16:55:43.620171+0000","last_clean":"2024-09-16T16:55:43.620171+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:55:43.620171+0000","last_undegraded":"2024-09-16T16:55:43.620171+0000","last_fullsized":"2024-09-16T16:55:43.620171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.988065+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:55:02.988065+0000","last_peered":"2024-09-16T16:55:02.988065+0000","last_clean":"2024-09-16T16:55:02.988065+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:55:02.988065+0000","last_undegraded":"2024-09-16T16:55:02.988065+0000","last_fullsized":"2024-09-16T16:55:02.988065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"54'935","reported_seq":968,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.492735+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:55:43.492735+0000","last_peered":"2024-09-16T16:55:43.492735+0000","last_clean":"2024-09-16T16:55:43.492735+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:55:43.492735+0000","last_undegraded":"2024-09-16T16:55:43.492735+0000","last_fullsized":"2024-09-16T16:55:43.492735+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.982776+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:55:02.982776+0000","last_peered":"2024-09-16T16:55:02.982776+0000","last_clean":"2024-09-16T16:55:02.982776+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:55:02.982776+0000","last_undegraded":"2024-09-16T16:55:02.982776+0000","last_fullsized":"2024-09-16T16:55:02.982776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"54'913","reported_seq":946,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.710260+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:55:43.710260+0000","last_peered":"2024-09-16T16:55:43.710260+0000","last_clean":"2024-09-16T16:55:43.710260+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:55:43.710260+0000","last_undegraded":"2024-09-16T16:55:43.710260+0000","last_fullsized":"2024-09-16T16:55:43.710260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":202309656,"num_objects":3088,"num_object_clones":0,"num_object_copies":9264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15184,"num_write_kb":584641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212954443776,"internally_reserved":0,"allocated":1257050112,"data_stored":1257050112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15184,"ondisk_log_size":15184,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212954312704,"internally_reserved":0,"allocated":1257181184,"data_stored":1257181184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53263073280,"internally_reserved":0,"allocated":289800192,"data_stored":289800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":286500,"kb_used_data":286500,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52011228,"statfs":{"total":53552873472,"available":53259497472,"internally_reserved":0,"allocated":293376000,"data_stored":293376000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":359108,"kb_used_data":359108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51938620,"statfs":{"total":53552873472,"available":53185146880,"internally_reserved":0,"allocated":367726592,"data_stored":367726592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":257312,"kb_used_data":257312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52040416,"statfs":{"total":53552873472,"available":53289385984,"internally_reserved":0,"allocated":263487488,"data_stored":263487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336120,"kb_used_data":336120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961608,"statfs":{"total":53552873472,"available":53208686592,"internally_reserved":0,"allocated":344186880,"data_stored":344186880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53263073280,"internally_reserved":0,"allocated":289800192,"data_stored":289800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53210394624,"internally_reserved":0,"allocated":342478848,"data_stored":342478848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53292732416,"internally_reserved":0,"allocated":260141056,"data_stored":260141056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53187981312,"internally_reserved":0,"allocated":364892160,"data_stored":364892160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53263204352,"internally_reserved":0,"allocated":289669120,"data_stored":289669120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53210525696,"internally_reserved":0,"allocated":342347776,"data_stored":342347776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53292732416,"internally_reserved":0,"allocated":260141056,"data_stored":260141056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53187981312,"internally_reserved":0,"allocated":364892160,"data_stored":364892160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53263204352,"internally_reserved":0,"allocated":289669120,"data_stored":289669120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:56.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:56.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:56.150+0000 7f63a8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:56.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:56.158+0000 7f63a8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:58.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:58.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:58.668+0000 7f2bf2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:58.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:55:58.676+0000 7f2bf2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:00.976 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:00.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:00.976 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:00.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:01.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:01.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.135+0000 7fb658311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.148+0000 7fb658311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.193+0000 7f0a5ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.200+0000 7f0a5ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:01.202 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:01.203 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:01.206 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:01.207 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:01.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.340+0000 7f557fd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.357+0000 7f557fd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.463 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:01.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:01.469 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:01.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:01.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.629+0000 7fe3ac391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.644+0000 7fe3ac391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:01.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:01.746 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:01.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:01.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.893+0000 7ff3ee07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:01.910+0000 7ff3ee07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:01.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:01.994 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:03.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:03.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:03.707+0000 7f1d0cd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:03.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:03.714+0000 7f1d0cd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:06.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:06.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:06.191+0000 7f2f5e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:06.198+0000 7f2f5e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:06.995 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:06.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:06.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:07.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:07.139+0000 7f342b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:07.151+0000 7f342b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:56:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:56:07.542 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-16T16:56:05.874113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":202900043,"num_objects":3092,"num_object_clones":0,"num_object_copies":9276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15265,"num_write_kb":585749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15239,"ondisk_log_size":15239,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1239040,"kb_used_data":1239040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207951872,"statfs":{"total":214211493888,"available":212942716928,"internally_reserved":0,"allocated":1268776960,"data_stored":1268776960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002433"},"pg_stats":[{"pgid":"5.f","version":"54'1011","reported_seq":1044,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.128187+0000","last_change":"2024-09-16T16:53:16.994679+0000","last_active":"2024-09-16T16:55:43.128187+0000","last_peered":"2024-09-16T16:55:43.128187+0000","last_clean":"2024-09-16T16:55:43.128187+0000","last_became_active":"2024-09-16T16:53:16.986625+0000","last_became_peered":"2024-09-16T16:53:16.986625+0000","last_unstale":"2024-09-16T16:55:43.128187+0000","last_undegraded":"2024-09-16T16:55:43.128187+0000","last_fullsized":"2024-09-16T16:55:43.128187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"54'999","reported_seq":1032,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:42.882851+0000","last_change":"2024-09-16T16:53:16.925869+0000","last_active":"2024-09-16T16:55:42.882851+0000","last_peered":"2024-09-16T16:55:42.882851+0000","last_clean":"2024-09-16T16:55:42.882851+0000","last_became_active":"2024-09-16T16:53:16.894998+0000","last_became_peered":"2024-09-16T16:53:16.894998+0000","last_unstale":"2024-09-16T16:55:42.882851+0000","last_undegraded":"2024-09-16T16:55:42.882851+0000","last_fullsized":"2024-09-16T16:55:42.882851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"54'932","reported_seq":966,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.524875+0000","last_change":"2024-09-16T16:53:17.005096+0000","last_active":"2024-09-16T16:55:43.524875+0000","last_peered":"2024-09-16T16:55:43.524875+0000","last_clean":"2024-09-16T16:55:43.524875+0000","last_became_active":"2024-09-16T16:53:16.998339+0000","last_became_peered":"2024-09-16T16:53:16.998339+0000","last_unstale":"2024-09-16T16:55:43.524875+0000","last_undegraded":"2024-09-16T16:55:43.524875+0000","last_fullsized":"2024-09-16T16:55:43.524875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599896,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":932,"num_write_kb":35457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"54'927","reported_seq":960,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.291443+0000","last_change":"2024-09-16T16:53:16.888560+0000","last_active":"2024-09-16T16:55:43.291443+0000","last_peered":"2024-09-16T16:55:43.291443+0000","last_clean":"2024-09-16T16:55:43.291443+0000","last_became_active":"2024-09-16T16:53:16.844587+0000","last_became_peered":"2024-09-16T16:53:16.844587+0000","last_unstale":"2024-09-16T16:55:43.291443+0000","last_undegraded":"2024-09-16T16:55:43.291443+0000","last_fullsized":"2024-09-16T16:55:43.291443+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"54'944","reported_seq":977,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.568198+0000","last_change":"2024-09-16T16:53:16.917287+0000","last_active":"2024-09-16T16:55:43.568198+0000","last_peered":"2024-09-16T16:55:43.568198+0000","last_clean":"2024-09-16T16:55:43.568198+0000","last_became_active":"2024-09-16T16:53:16.879219+0000","last_became_peered":"2024-09-16T16:53:16.879219+0000","last_unstale":"2024-09-16T16:55:43.568198+0000","last_undegraded":"2024-09-16T16:55:43.568198+0000","last_fullsized":"2024-09-16T16:55:43.568198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"54'949","reported_seq":982,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.340085+0000","last_change":"2024-09-16T16:53:16.895733+0000","last_active":"2024-09-16T16:55:43.340085+0000","last_peered":"2024-09-16T16:55:43.340085+0000","last_clean":"2024-09-16T16:55:43.340085+0000","last_became_active":"2024-09-16T16:53:16.878108+0000","last_became_peered":"2024-09-16T16:53:16.878108+0000","last_unstale":"2024-09-16T16:55:43.340085+0000","last_undegraded":"2024-09-16T16:55:43.340085+0000","last_fullsized":"2024-09-16T16:55:43.340085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"54'923","reported_seq":956,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:42.805377+0000","last_change":"2024-09-16T16:53:16.916986+0000","last_active":"2024-09-16T16:55:42.805377+0000","last_peered":"2024-09-16T16:55:42.805377+0000","last_clean":"2024-09-16T16:55:42.805377+0000","last_became_active":"2024-09-16T16:53:16.909269+0000","last_became_peered":"2024-09-16T16:53:16.909269+0000","last_unstale":"2024-09-16T16:55:42.805377+0000","last_undegraded":"2024-09-16T16:55:42.805377+0000","last_fullsized":"2024-09-16T16:55:42.805377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"54'932","reported_seq":965,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.770815+0000","last_change":"2024-09-16T16:53:16.905420+0000","last_active":"2024-09-16T16:55:43.770815+0000","last_peered":"2024-09-16T16:55:43.770815+0000","last_clean":"2024-09-16T16:55:43.770815+0000","last_became_active":"2024-09-16T16:53:16.869003+0000","last_became_peered":"2024-09-16T16:53:16.869003+0000","last_unstale":"2024-09-16T16:55:43.770815+0000","last_undegraded":"2024-09-16T16:55:43.770815+0000","last_fullsized":"2024-09-16T16:55:43.770815+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":932,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"54'950","reported_seq":983,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.231766+0000","last_change":"2024-09-16T16:53:17.021766+0000","last_active":"2024-09-16T16:55:43.231766+0000","last_peered":"2024-09-16T16:55:43.231766+0000","last_clean":"2024-09-16T16:55:43.231766+0000","last_became_active":"2024-09-16T16:53:17.013458+0000","last_became_peered":"2024-09-16T16:53:17.013458+0000","last_unstale":"2024-09-16T16:55:43.231766+0000","last_undegraded":"2024-09-16T16:55:43.231766+0000","last_fullsized":"2024-09-16T16:55:43.231766+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":950,"num_write_kb":36480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.981690+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:55:02.981690+0000","last_peered":"2024-09-16T16:55:02.981690+0000","last_clean":"2024-09-16T16:55:02.981690+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:55:02.981690+0000","last_undegraded":"2024-09-16T16:55:02.981690+0000","last_fullsized":"2024-09-16T16:55:02.981690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"54'1010","reported_seq":1043,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.708539+0000","last_change":"2024-09-16T16:53:16.992253+0000","last_active":"2024-09-16T16:55:43.708539+0000","last_peered":"2024-09-16T16:55:43.708539+0000","last_clean":"2024-09-16T16:55:43.708539+0000","last_became_active":"2024-09-16T16:53:16.985602+0000","last_became_peered":"2024-09-16T16:53:16.985602+0000","last_unstale":"2024-09-16T16:55:43.708539+0000","last_undegraded":"2024-09-16T16:55:43.708539+0000","last_fullsized":"2024-09-16T16:55:43.708539+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"54'954","reported_seq":987,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.846769+0000","last_change":"2024-09-16T16:53:16.930973+0000","last_active":"2024-09-16T16:55:43.846769+0000","last_peered":"2024-09-16T16:55:43.846769+0000","last_clean":"2024-09-16T16:55:43.846769+0000","last_became_active":"2024-09-16T16:53:16.920342+0000","last_became_peered":"2024-09-16T16:53:16.920342+0000","last_unstale":"2024-09-16T16:55:43.846769+0000","last_undegraded":"2024-09-16T16:55:43.846769+0000","last_fullsized":"2024-09-16T16:55:43.846769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"54'974","reported_seq":1007,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.551820+0000","last_change":"2024-09-16T16:53:16.888142+0000","last_active":"2024-09-16T16:55:43.551820+0000","last_peered":"2024-09-16T16:55:43.551820+0000","last_clean":"2024-09-16T16:55:43.551820+0000","last_became_active":"2024-09-16T16:53:16.854581+0000","last_became_peered":"2024-09-16T16:53:16.854581+0000","last_unstale":"2024-09-16T16:55:43.551820+0000","last_undegraded":"2024-09-16T16:55:43.551820+0000","last_fullsized":"2024-09-16T16:55:43.551820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"54'946","reported_seq":979,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.606051+0000","last_change":"2024-09-16T16:53:16.940312+0000","last_active":"2024-09-16T16:55:43.606051+0000","last_peered":"2024-09-16T16:55:43.606051+0000","last_clean":"2024-09-16T16:55:43.606051+0000","last_became_active":"2024-09-16T16:53:16.893218+0000","last_became_peered":"2024-09-16T16:53:16.893218+0000","last_unstale":"2024-09-16T16:55:43.606051+0000","last_undegraded":"2024-09-16T16:55:43.606051+0000","last_fullsized":"2024-09-16T16:55:43.606051+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":946,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.992103+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:55:02.992103+0000","last_peered":"2024-09-16T16:55:02.992103+0000","last_clean":"2024-09-16T16:55:02.992103+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:55:02.992103+0000","last_undegraded":"2024-09-16T16:55:02.992103+0000","last_fullsized":"2024-09-16T16:55:02.992103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"54'885","reported_seq":918,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.620171+0000","last_change":"2024-09-16T16:53:16.912222+0000","last_active":"2024-09-16T16:55:43.620171+0000","last_peered":"2024-09-16T16:55:43.620171+0000","last_clean":"2024-09-16T16:55:43.620171+0000","last_became_active":"2024-09-16T16:53:16.862464+0000","last_became_peered":"2024-09-16T16:53:16.862464+0000","last_unstale":"2024-09-16T16:55:43.620171+0000","last_undegraded":"2024-09-16T16:55:43.620171+0000","last_fullsized":"2024-09-16T16:55:43.620171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.988065+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:55:02.988065+0000","last_peered":"2024-09-16T16:55:02.988065+0000","last_clean":"2024-09-16T16:55:02.988065+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:55:02.988065+0000","last_undegraded":"2024-09-16T16:55:02.988065+0000","last_fullsized":"2024-09-16T16:55:02.988065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"54'935","reported_seq":968,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.492735+0000","last_change":"2024-09-16T16:53:16.951757+0000","last_active":"2024-09-16T16:55:43.492735+0000","last_peered":"2024-09-16T16:55:43.492735+0000","last_clean":"2024-09-16T16:55:43.492735+0000","last_became_active":"2024-09-16T16:53:16.933067+0000","last_became_peered":"2024-09-16T16:53:16.933067+0000","last_unstale":"2024-09-16T16:55:43.492735+0000","last_undegraded":"2024-09-16T16:55:43.492735+0000","last_fullsized":"2024-09-16T16:55:43.492735+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.982776+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:55:02.982776+0000","last_peered":"2024-09-16T16:55:02.982776+0000","last_clean":"2024-09-16T16:55:02.982776+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:55:02.982776+0000","last_undegraded":"2024-09-16T16:55:02.982776+0000","last_fullsized":"2024-09-16T16:55:02.982776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"54'913","reported_seq":946,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:43.710260+0000","last_change":"2024-09-16T16:53:16.956640+0000","last_active":"2024-09-16T16:55:43.710260+0000","last_peered":"2024-09-16T16:55:43.710260+0000","last_clean":"2024-09-16T16:55:43.710260+0000","last_became_active":"2024-09-16T16:53:16.941190+0000","last_became_peered":"2024-09-16T16:53:16.941190+0000","last_unstale":"2024-09-16T16:55:43.710260+0000","last_undegraded":"2024-09-16T16:55:43.710260+0000","last_fullsized":"2024-09-16T16:55:43.710260+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:53:15.715753+0000","last_clean_scrub_stamp":"2024-09-16T16:53:15.715753+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":202309656,"num_objects":3088,"num_object_clones":0,"num_object_copies":9264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15184,"num_write_kb":584641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212954443776,"internally_reserved":0,"allocated":1257050112,"data_stored":1257050112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15184,"ondisk_log_size":15184,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212954312704,"internally_reserved":0,"allocated":1257181184,"data_stored":1257181184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53263073280,"internally_reserved":0,"allocated":289800192,"data_stored":289800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":286500,"kb_used_data":286500,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52011228,"statfs":{"total":53552873472,"available":53259497472,"internally_reserved":0,"allocated":293376000,"data_stored":293376000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":359108,"kb_used_data":359108,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51938620,"statfs":{"total":53552873472,"available":53185146880,"internally_reserved":0,"allocated":367726592,"data_stored":367726592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":257312,"kb_used_data":257312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52040416,"statfs":{"total":53552873472,"available":53289385984,"internally_reserved":0,"allocated":263487488,"data_stored":263487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336120,"kb_used_data":336120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961608,"statfs":{"total":53552873472,"available":53208686592,"internally_reserved":0,"allocated":344186880,"data_stored":344186880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53263073280,"internally_reserved":0,"allocated":289800192,"data_stored":289800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53210394624,"internally_reserved":0,"allocated":342478848,"data_stored":342478848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53292732416,"internally_reserved":0,"allocated":260141056,"data_stored":260141056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53187981312,"internally_reserved":0,"allocated":364892160,"data_stored":364892160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53263204352,"internally_reserved":0,"allocated":289669120,"data_stored":289669120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53210525696,"internally_reserved":0,"allocated":342347776,"data_stored":342347776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53292732416,"internally_reserved":0,"allocated":260141056,"data_stored":260141056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53187981312,"internally_reserved":0,"allocated":364892160,"data_stored":364892160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53263204352,"internally_reserved":0,"allocated":289669120,"data_stored":289669120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:08.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:08.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:08.567+0000 7f74f1a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:08.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:08.576+0000 7f74f1a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:10.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:10.951+0000 7f9e7db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:10.961+0000 7f9e7db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.545 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:12.545 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:12.545 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:12.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:12.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:12.688+0000 7f95edad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:12.700+0000 7f95edad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:12.757 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:12.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:12.758 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:12.758 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:12.760 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:12.760 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:12.761 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:12.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:12.899+0000 7f736e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:12.915+0000 7f736e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.954 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:12.955 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:12.959 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:12.959 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:12.959 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:13.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.099+0000 7f3845991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.110+0000 7f3845991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.154 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:13.155 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:13.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:13.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:13.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:13.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.295+0000 7fb05c0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.306+0000 7fb05c0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:13.358 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:13.359 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:13.362 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:13.363 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:13.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:13.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.517+0000 7f5b752a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:13.526+0000 7f5b752a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.151 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 9135 objects 2024-09-16T16:56:15.151 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :86.2545 2024-09-16T16:56:15.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:15.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:15.840+0000 7f84ecf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:15.844+0000 7f84ecf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:17.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.064+0000 7f85c8688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.070+0000 7f85c8688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.364 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:18.364 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:18.364 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:18.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:18.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.469+0000 7ff3d78d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.478+0000 7ff3d78d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:18.493 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:18.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:18.496 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:18.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.599+0000 7f9271991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.608+0000 7f9271991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:18.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:18.629 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:18.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:18.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.732+0000 7f1e600c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.741+0000 7f1e600c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.764 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:18.764 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:18.765 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:18.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:18.768 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:18.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:18.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.872+0000 7fa835991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:18.881+0000 7fa835991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:18.902 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:18.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:18.903 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:18.903 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:18.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:18.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:20.193 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:20.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:20.310+0000 7ff89e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:20.316+0000 7ff89e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.832 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-16T16:56:20.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-16T16:56:20.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:20.952+0000 7feaf5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:20.966+0000 7feaf5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:21.754 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_2' removed 2024-09-16T16:56:21.778 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:56:21.779 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:56:21.779 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-16T16:56:21.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-16T16:56:21.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:21.951+0000 7f63198fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:21.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:21.972+0000 7f63198fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:22.422 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:22.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:22.525+0000 7fe51ac23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:22.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:22.531+0000 7fe51ac23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_3' created 2024-09-16T16:56:22.786 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-16T16:56:22.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:22.912+0000 7f15e2f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:22.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:22.925+0000 7f15e2f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-16T16:56:23.906 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:23.906 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:23.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:24.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:24.062+0000 7f67c5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:24.073+0000 7f67c5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.262 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:56:24.263 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:56:24.275 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-16T16:56:23.878000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":84292,"kb_used_data":84292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209106620,"statfs":{"total":214211493888,"available":214125178880,"internally_reserved":0,"allocated":86315008,"data_stored":86315008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6357016,"num_objects":-98,"num_object_clones":0,"num_object_copies":-294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-18174,"num_write_kb":-584641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001305"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.981690+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:55:02.981690+0000","last_peered":"2024-09-16T16:55:02.981690+0000","last_clean":"2024-09-16T16:55:02.981690+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:55:02.981690+0000","last_undegraded":"2024-09-16T16:55:02.981690+0000","last_fullsized":"2024-09-16T16:55:02.981690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.992103+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:55:02.992103+0000","last_peered":"2024-09-16T16:55:02.992103+0000","last_clean":"2024-09-16T16:55:02.992103+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:55:02.992103+0000","last_undegraded":"2024-09-16T16:55:02.992103+0000","last_fullsized":"2024-09-16T16:55:02.992103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.988065+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:55:02.988065+0000","last_peered":"2024-09-16T16:55:02.988065+0000","last_clean":"2024-09-16T16:55:02.988065+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:55:02.988065+0000","last_undegraded":"2024-09-16T16:55:02.988065+0000","last_fullsized":"2024-09-16T16:55:02.988065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.982776+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:55:02.982776+0000","last_peered":"2024-09-16T16:55:02.982776+0000","last_clean":"2024-09-16T16:55:02.982776+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:55:02.982776+0000","last_undegraded":"2024-09-16T16:55:02.982776+0000","last_fullsized":"2024-09-16T16:55:02.982776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214135529472,"internally_reserved":0,"allocated":75964416,"data_stored":75964416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22204,"kb_used_data":22204,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275524,"statfs":{"total":53552873472,"available":53530136576,"internally_reserved":0,"allocated":22736896,"data_stored":22736896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22220,"kb_used_data":22220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275508,"statfs":{"total":53552873472,"available":53530120192,"internally_reserved":0,"allocated":22753280,"data_stored":22753280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17612,"kb_used_data":17612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280116,"statfs":{"total":53552873472,"available":53534838784,"internally_reserved":0,"allocated":18034688,"data_stored":18034688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22256,"kb_used_data":22256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275472,"statfs":{"total":53552873472,"available":53530083328,"internally_reserved":0,"allocated":22790144,"data_stored":22790144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53530738688,"internally_reserved":0,"allocated":22134784,"data_stored":22134784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53538041856,"internally_reserved":0,"allocated":14831616,"data_stored":14831616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53531844608,"internally_reserved":0,"allocated":21028864,"data_stored":21028864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:24.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:24.736+0000 7f9058f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:24.742+0000 7f9058f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.796 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-16T16:56:24.798 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:56:24.798 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:56:24.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-16T16:56:24.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:56:24.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_52133 2024-09-16T16:56:24.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:56:24.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:56:25.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 113 97 6.0621 6.0625 0.15225 0.150558 2024-09-16T16:56:26.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:26.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 207 191 5.96833 5.875 0.531288 0.159488 2024-09-16T16:56:27.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:27.018+0000 7f1a84f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:27.027+0000 7f1a84f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.865 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 301 285 5.93703 5.875 0.28943 0.161529 2024-09-16T16:56:28.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 409 393 6.14011 6.75 0.180206 0.157957 2024-09-16T16:56:29.278 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:29.278 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:29.278 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:29.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:29.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.435+0000 7faa28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.448+0000 7faa28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:29.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:29.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:29.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.680+0000 7fd3ba674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.688+0000 7fd3ba674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.757+0000 7f728c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:29.775+0000 7f728c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 524 508 6.34945 7.1875 0.0546947 0.154073 2024-09-16T16:56:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:29.889 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:29.890 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:29.893 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:29.894 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:29.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:30.035+0000 7faae8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:30.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:30.049+0000 7faae8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:30.135 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:30.136 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:30.136 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:30.136 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:30.140 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:30.140 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:30.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:30.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:30.300+0000 7fad468fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:30.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:30.316+0000 7fad468fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:30.341 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:30.341 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:30.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 622 606 6.31194 6.125 0.130437 0.155847 2024-09-16T16:56:31.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 739 723 6.45478 7.3125 0.239081 0.153119 2024-09-16T16:56:32.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:32.243+0000 7fad3ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:32.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:32.251+0000 7fad3ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:32.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 834 818 6.39005 5.9375 0.105687 0.153514 2024-09-16T16:56:33.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 946 930 6.45776 7 0.293205 0.152632 2024-09-16T16:56:34.589 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:34.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:34.766+0000 7f7181191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:34.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:34.777+0000 7f7181191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:34.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 1071 1055 6.59316 7.8125 0.131184 0.150464 2024-09-16T16:56:35.342 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:35.342 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:35.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:35.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:35.522+0000 7f13bdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:35.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:35.539+0000 7f13bdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:35.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 1186 1170 6.64713 7.1875 0.179191 0.14892 2024-09-16T16:56:35.917 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:56:35.917 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:56:35.937 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-16T16:56:35.880360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":84292,"kb_used_data":84292,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209106620,"statfs":{"total":214211493888,"available":214125178880,"internally_reserved":0,"allocated":86315008,"data_stored":86315008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.098437"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":202,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.981690+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:55:02.981690+0000","last_peered":"2024-09-16T16:55:02.981690+0000","last_clean":"2024-09-16T16:55:02.981690+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:55:02.981690+0000","last_undegraded":"2024-09-16T16:55:02.981690+0000","last_fullsized":"2024-09-16T16:55:02.981690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.968428+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:55:02.968428+0000","last_peered":"2024-09-16T16:55:02.968428+0000","last_clean":"2024-09-16T16:55:02.968428+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:55:02.968428+0000","last_undegraded":"2024-09-16T16:55:02.968428+0000","last_fullsized":"2024-09-16T16:55:02.968428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.020148+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:55:03.020148+0000","last_peered":"2024-09-16T16:55:03.020148+0000","last_clean":"2024-09-16T16:55:03.020148+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:55:03.020148+0000","last_undegraded":"2024-09-16T16:55:03.020148+0000","last_fullsized":"2024-09-16T16:55:03.020148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.963842+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:55:02.963842+0000","last_peered":"2024-09-16T16:55:02.963842+0000","last_clean":"2024-09-16T16:55:02.963842+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:55:02.963842+0000","last_undegraded":"2024-09-16T16:55:02.963842+0000","last_fullsized":"2024-09-16T16:55:02.963842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":132,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:03.021405+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:55:03.021405+0000","last_peered":"2024-09-16T16:55:03.021405+0000","last_clean":"2024-09-16T16:55:03.021405+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:55:03.021405+0000","last_undegraded":"2024-09-16T16:55:03.021405+0000","last_fullsized":"2024-09-16T16:55:03.021405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.992103+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:55:02.992103+0000","last_peered":"2024-09-16T16:55:02.992103+0000","last_clean":"2024-09-16T16:55:02.992103+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:55:02.992103+0000","last_undegraded":"2024-09-16T16:55:02.992103+0000","last_fullsized":"2024-09-16T16:55:02.992103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.988065+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:55:02.988065+0000","last_peered":"2024-09-16T16:55:02.988065+0000","last_clean":"2024-09-16T16:55:02.988065+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:55:02.988065+0000","last_undegraded":"2024-09-16T16:55:02.988065+0000","last_fullsized":"2024-09-16T16:55:02.988065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.982776+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:55:02.982776+0000","last_peered":"2024-09-16T16:55:02.982776+0000","last_clean":"2024-09-16T16:55:02.982776+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:55:02.982776+0000","last_undegraded":"2024-09-16T16:55:02.982776+0000","last_fullsized":"2024-09-16T16:55:02.982776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:22.763047+0000","last_change":"2024-09-16T16:56:22.763047+0000","last_active":"2024-09-16T16:56:22.763047+0000","last_peered":"2024-09-16T16:56:22.763047+0000","last_clean":"2024-09-16T16:56:22.763047+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:22.763047+0000","last_undegraded":"2024-09-16T16:56:22.763047+0000","last_fullsized":"2024-09-16T16:56:22.763047+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-16T16:55:02.966880+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:55:02.966880+0000","last_peered":"2024-09-16T16:55:02.966880+0000","last_clean":"2024-09-16T16:55:02.966880+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:55:02.966880+0000","last_undegraded":"2024-09-16T16:55:02.966880+0000","last_fullsized":"2024-09-16T16:55:02.966880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214135529472,"internally_reserved":0,"allocated":75964416,"data_stored":75964416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22204,"kb_used_data":22204,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275524,"statfs":{"total":53552873472,"available":53530136576,"internally_reserved":0,"allocated":22736896,"data_stored":22736896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22220,"kb_used_data":22220,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275508,"statfs":{"total":53552873472,"available":53530120192,"internally_reserved":0,"allocated":22753280,"data_stored":22753280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17612,"kb_used_data":17612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280116,"statfs":{"total":53552873472,"available":53534838784,"internally_reserved":0,"allocated":18034688,"data_stored":18034688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":22256,"kb_used_data":22256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275472,"statfs":{"total":53552873472,"available":53530083328,"internally_reserved":0,"allocated":22790144,"data_stored":22790144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53530738688,"internally_reserved":0,"allocated":22134784,"data_stored":22134784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53538041856,"internally_reserved":0,"allocated":14831616,"data_stored":14831616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53531844608,"internally_reserved":0,"allocated":21028864,"data_stored":21028864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53534904320,"internally_reserved":0,"allocated":17969152,"data_stored":17969152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:36.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1309 1293 6.73377 7.6875 0.0981437 0.147358 2024-09-16T16:56:37.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:37.398+0000 7f5daa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:37.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:37.404+0000 7f5daa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:37.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1437 1421 6.83111 8 0.0847646 0.145468 2024-09-16T16:56:38.866 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1563 1547 6.90562 7.875 0.11176 0.144147 2024-09-16T16:56:39.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1690 1674 6.97437 7.9375 0.0557162 0.142694 2024-09-16T16:56:39.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:40.119+0000 7fddfce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:40.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:40.129+0000 7fddfce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:40.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1808 1792 6.99936 7.375 0.163895 0.142348 2024-09-16T16:56:40.939 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:40.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:40.940 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:40.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.084+0000 7f8ee6a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.098+0000 7f8ee6a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:41.202 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:41.203 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:41.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:41.206 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:41.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:41.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.374+0000 7f09d14d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.390+0000 7f09d14d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.532 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:41.533 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:41.536 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:41.536 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:41.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:41.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.703+0000 7f515d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.721+0000 7f515d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:41.785 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:41.786 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:41.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:41.790 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:41.790 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:41.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1917 1901 6.98833 6.8125 0.1185 0.142507 2024-09-16T16:56:41.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.970+0000 7ffac9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:41.989+0000 7ffac9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:42.057 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:42.058 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:42.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:42.062 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:42.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:42.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:42.826+0000 7f1044a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:42.836+0000 7f1044a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:42.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 2039 2023 7.02366 7.625 0.327174 0.141712 2024-09-16T16:56:43.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 2151 2135 7.02238 7 0.191092 0.141802 2024-09-16T16:56:44.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:56:44.867531+0000 min lat: 0.0228392 max lat: 0.666096 avg lat: 0.142021 2024-09-16T16:56:44.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:56:44.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 2259 2243 7.00874 6.75 0.158082 0.142021 2024-09-16T16:56:45.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:45.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:45.494+0000 7f81b6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:45.504+0000 7f81b6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 2365 2349 6.99043 6.625 0.108066 0.142379 2024-09-16T16:56:46.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2478 2462 6.99367 7.0625 0.147286 0.142256 2024-09-16T16:56:47.062 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:47.063 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:47.063 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:47.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:47.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.232+0000 7f9340f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.247+0000 7f9340f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:47.357 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:47.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:47.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:47.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.508+0000 7fcc5af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.520+0000 7fcc5af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.638 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:47.638 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:47.638 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:47.638 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:47.642 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:47.643 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:47.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.801+0000 7fad35863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:47.815+0000 7fad35863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2586 2570 6.98305 6.75 0.137309 0.142724 2024-09-16T16:56:47.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:47.971 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:47.971 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:47.971 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:47.972 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:47.976 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:47.976 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:47.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:48.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:48.062+0000 7f5732b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:48.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:48.072+0000 7f5732b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:48.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:48.145+0000 7f789987d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:48.159+0000 7f789987d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:48.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:48.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:48.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 2694 2678 6.97332 6.75 0.0770563 0.142761 2024-09-16T16:56:49.867 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 2813 2797 6.99186 7.4375 0.254014 0.142312 2024-09-16T16:56:50.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:50.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:50.701+0000 7fe8c6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:50.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:50.709+0000 7fe8c6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:50.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2918 2902 6.97529 6.5625 0.10233 0.142945 2024-09-16T16:56:51.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 3029 3013 6.97387 6.9375 0.146785 0.143049 2024-09-16T16:56:52.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 3142 3126 6.97701 7.0625 0.143127 0.142885 2024-09-16T16:56:53.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:53.191 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:53.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:56:53.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:53.277+0000 7f9eec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:53.288+0000 7f9eec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:53.366+0000 7fcbef791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:53.385+0000 7fcbef791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:53.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 3249 3233 6.967 6.6875 0.168194 0.143128 2024-09-16T16:56:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:56:54.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:56:54.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 3361 3345 6.96807 7 0.17343 0.142971 2024-09-16T16:56:54.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:54.977+0000 7f944e297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:54.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:54.992+0000 7f944e297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.750 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:56:55.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:56:55.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:55.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3459 3443 6.94087 6.125 0.0361599 0.143497 2024-09-16T16:56:55.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:55.958+0000 7ff407791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:55.974+0000 7ff407791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:56.014+0000 7f1a10d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:56.025+0000 7f1a0b59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.756 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:56:56.782 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:56:56.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 3560 3544 6.92121 6.3125 0.153702 0.143929 2024-09-16T16:56:56.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:56.947+0000 7f60d5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:56.967+0000 7f60d5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:56:57.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:56:57.790 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:57.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 3676 3660 6.93115 7.25 0.132015 0.143923 2024-09-16T16:56:57.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:57.923+0000 7f3cc4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:57.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:57.935+0000 7f3cc4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:56:58.221 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:56:58.244 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-16T16:56:57.885262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":141361715,"num_objects":2152,"num_object_clones":0,"num_object_copies":6456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2229,"num_write_kb":138580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2203,"ondisk_log_size":2203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":824876,"kb_used_data":824876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208366036,"statfs":{"total":214211493888,"available":213366820864,"internally_reserved":0,"allocated":844673024,"data_stored":844673024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000914"},"pg_stats":[{"pgid":"6.f","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.344180+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:56:43.344180+0000","last_peered":"2024-09-16T16:56:43.344180+0000","last_clean":"2024-09-16T16:56:43.344180+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:56:43.344180+0000","last_undegraded":"2024-09-16T16:56:43.344180+0000","last_fullsized":"2024-09-16T16:56:43.344180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.657912+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:56:43.657912+0000","last_peered":"2024-09-16T16:56:43.657912+0000","last_clean":"2024-09-16T16:56:43.657912+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:56:43.657912+0000","last_undegraded":"2024-09-16T16:56:43.657912+0000","last_fullsized":"2024-09-16T16:56:43.657912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.155747+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:56:43.155747+0000","last_peered":"2024-09-16T16:56:43.155747+0000","last_clean":"2024-09-16T16:56:43.155747+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:56:43.155747+0000","last_undegraded":"2024-09-16T16:56:43.155747+0000","last_fullsized":"2024-09-16T16:56:43.155747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.771195+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:56:43.771195+0000","last_peered":"2024-09-16T16:56:43.771195+0000","last_clean":"2024-09-16T16:56:43.771195+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:56:43.771195+0000","last_undegraded":"2024-09-16T16:56:43.771195+0000","last_fullsized":"2024-09-16T16:56:43.771195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'131","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.236033+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:56:43.236033+0000","last_peered":"2024-09-16T16:56:43.236033+0000","last_clean":"2024-09-16T16:56:43.236033+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:56:43.236033+0000","last_undegraded":"2024-09-16T16:56:43.236033+0000","last_fullsized":"2024-09-16T16:56:43.236033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"58'125","reported_seq":137,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.875747+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:56:43.875747+0000","last_peered":"2024-09-16T16:56:43.875747+0000","last_clean":"2024-09-16T16:56:43.875747+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:56:43.875747+0000","last_undegraded":"2024-09-16T16:56:43.875747+0000","last_fullsized":"2024-09-16T16:56:43.875747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.795024+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:56:43.795024+0000","last_peered":"2024-09-16T16:56:43.795024+0000","last_clean":"2024-09-16T16:56:43.795024+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:56:43.795024+0000","last_undegraded":"2024-09-16T16:56:43.795024+0000","last_fullsized":"2024-09-16T16:56:43.795024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.559085+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:56:43.559085+0000","last_peered":"2024-09-16T16:56:43.559085+0000","last_clean":"2024-09-16T16:56:43.559085+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:56:43.559085+0000","last_undegraded":"2024-09-16T16:56:43.559085+0000","last_fullsized":"2024-09-16T16:56:43.559085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.514051+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:56:43.514051+0000","last_peered":"2024-09-16T16:56:43.514051+0000","last_clean":"2024-09-16T16:56:43.514051+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:56:43.514051+0000","last_undegraded":"2024-09-16T16:56:43.514051+0000","last_fullsized":"2024-09-16T16:56:43.514051+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.804548+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:56:24.804548+0000","last_peered":"2024-09-16T16:56:24.804548+0000","last_clean":"2024-09-16T16:56:24.804548+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:56:24.804548+0000","last_undegraded":"2024-09-16T16:56:24.804548+0000","last_fullsized":"2024-09-16T16:56:24.804548+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.812059+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:56:24.812059+0000","last_peered":"2024-09-16T16:56:24.812059+0000","last_clean":"2024-09-16T16:56:24.812059+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:56:24.812059+0000","last_undegraded":"2024-09-16T16:56:24.812059+0000","last_fullsized":"2024-09-16T16:56:24.812059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"58'134","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.248469+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:56:43.248469+0000","last_peered":"2024-09-16T16:56:43.248469+0000","last_clean":"2024-09-16T16:56:43.248469+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:56:43.248469+0000","last_undegraded":"2024-09-16T16:56:43.248469+0000","last_fullsized":"2024-09-16T16:56:43.248469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808766+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:56:24.808766+0000","last_peered":"2024-09-16T16:56:24.808766+0000","last_clean":"2024-09-16T16:56:24.808766+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:56:24.808766+0000","last_undegraded":"2024-09-16T16:56:24.808766+0000","last_fullsized":"2024-09-16T16:56:24.808766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"58'151","reported_seq":163,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.780283+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:56:43.780283+0000","last_peered":"2024-09-16T16:56:43.780283+0000","last_clean":"2024-09-16T16:56:43.780283+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:56:43.780283+0000","last_undegraded":"2024-09-16T16:56:43.780283+0000","last_fullsized":"2024-09-16T16:56:43.780283+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809469+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:56:24.809469+0000","last_peered":"2024-09-16T16:56:24.809469+0000","last_clean":"2024-09-16T16:56:24.809469+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:56:24.809469+0000","last_undegraded":"2024-09-16T16:56:24.809469+0000","last_fullsized":"2024-09-16T16:56:24.809469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"58'124","reported_seq":136,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.653150+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:56:43.653150+0000","last_peered":"2024-09-16T16:56:43.653150+0000","last_clean":"2024-09-16T16:56:43.653150+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:56:43.653150+0000","last_undegraded":"2024-09-16T16:56:43.653150+0000","last_fullsized":"2024-09-16T16:56:43.653150+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808691+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:56:24.808691+0000","last_peered":"2024-09-16T16:56:24.808691+0000","last_clean":"2024-09-16T16:56:24.808691+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:56:24.808691+0000","last_undegraded":"2024-09-16T16:56:24.808691+0000","last_fullsized":"2024-09-16T16:56:24.808691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"58'135","reported_seq":147,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.871714+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:56:43.871714+0000","last_peered":"2024-09-16T16:56:43.871714+0000","last_clean":"2024-09-16T16:56:43.871714+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:56:43.871714+0000","last_undegraded":"2024-09-16T16:56:43.871714+0000","last_fullsized":"2024-09-16T16:56:43.871714+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809738+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:56:24.809738+0000","last_peered":"2024-09-16T16:56:24.809738+0000","last_clean":"2024-09-16T16:56:24.809738+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:56:24.809738+0000","last_undegraded":"2024-09-16T16:56:24.809738+0000","last_fullsized":"2024-09-16T16:56:24.809738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.638024+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:56:43.638024+0000","last_peered":"2024-09-16T16:56:43.638024+0000","last_clean":"2024-09-16T16:56:43.638024+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:56:43.638024+0000","last_undegraded":"2024-09-16T16:56:43.638024+0000","last_fullsized":"2024-09-16T16:56:43.638024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.807708+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:56:24.807708+0000","last_peered":"2024-09-16T16:56:24.807708+0000","last_clean":"2024-09-16T16:56:24.807708+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:56:24.807708+0000","last_undegraded":"2024-09-16T16:56:24.807708+0000","last_fullsized":"2024-09-16T16:56:24.807708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'118","reported_seq":130,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.546650+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:56:43.546650+0000","last_peered":"2024-09-16T16:56:43.546650+0000","last_clean":"2024-09-16T16:56:43.546650+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:56:43.546650+0000","last_undegraded":"2024-09-16T16:56:43.546650+0000","last_fullsized":"2024-09-16T16:56:43.546650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809437+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:56:24.809437+0000","last_peered":"2024-09-16T16:56:24.809437+0000","last_clean":"2024-09-16T16:56:24.809437+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:56:24.809437+0000","last_undegraded":"2024-09-16T16:56:24.809437+0000","last_fullsized":"2024-09-16T16:56:24.809437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"58'132","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.673093+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:56:43.673093+0000","last_peered":"2024-09-16T16:56:43.673093+0000","last_clean":"2024-09-16T16:56:43.673093+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:56:43.673093+0000","last_undegraded":"2024-09-16T16:56:43.673093+0000","last_fullsized":"2024-09-16T16:56:43.673093+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.814888+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:56:24.814888+0000","last_peered":"2024-09-16T16:56:24.814888+0000","last_clean":"2024-09-16T16:56:24.814888+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:56:24.814888+0000","last_undegraded":"2024-09-16T16:56:24.814888+0000","last_fullsized":"2024-09-16T16:56:24.814888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":140771328,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2148,"num_write_kb":137472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213353869312,"internally_reserved":0,"allocated":857624576,"data_stored":857624576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2148,"ondisk_log_size":2148,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213354147840,"internally_reserved":0,"allocated":857346048,"data_stored":857346048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":188640,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52109088,"statfs":{"total":53552873472,"available":53359706112,"internally_reserved":0,"allocated":193167360,"data_stored":193167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":192832,"kb_used_data":192832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52104896,"statfs":{"total":53552873472,"available":53355413504,"internally_reserved":0,"allocated":197459968,"data_stored":197459968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":218700,"kb_used_data":218700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52079028,"statfs":{"total":53552873472,"available":53328924672,"internally_reserved":0,"allocated":223948800,"data_stored":223948800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224704,"kb_used_data":224704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52073024,"statfs":{"total":53552873472,"available":53322776576,"internally_reserved":0,"allocated":230096896,"data_stored":230096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53322117120,"internally_reserved":0,"allocated":230756352,"data_stored":230756352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53323939840,"internally_reserved":0,"allocated":228933632,"data_stored":228933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53321969664,"internally_reserved":0,"allocated":230903808,"data_stored":230903808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53323808768,"internally_reserved":0,"allocated":229064704,"data_stored":229064704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:58.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:58.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.409+0000 7f8acd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.424+0000 7f8acd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:58.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.601+0000 7fb5ff791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.612+0000 7fb5ff791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.784 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:56:58.784 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:56:58.804 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-16T16:56:57.885262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":141361715,"num_objects":2152,"num_object_clones":0,"num_object_copies":6456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2229,"num_write_kb":138580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2203,"ondisk_log_size":2203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":824876,"kb_used_data":824876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208366036,"statfs":{"total":214211493888,"available":213366820864,"internally_reserved":0,"allocated":844673024,"data_stored":844673024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000914"},"pg_stats":[{"pgid":"6.f","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.344180+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:56:43.344180+0000","last_peered":"2024-09-16T16:56:43.344180+0000","last_clean":"2024-09-16T16:56:43.344180+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:56:43.344180+0000","last_undegraded":"2024-09-16T16:56:43.344180+0000","last_fullsized":"2024-09-16T16:56:43.344180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.657912+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:56:43.657912+0000","last_peered":"2024-09-16T16:56:43.657912+0000","last_clean":"2024-09-16T16:56:43.657912+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:56:43.657912+0000","last_undegraded":"2024-09-16T16:56:43.657912+0000","last_fullsized":"2024-09-16T16:56:43.657912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.155747+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:56:43.155747+0000","last_peered":"2024-09-16T16:56:43.155747+0000","last_clean":"2024-09-16T16:56:43.155747+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:56:43.155747+0000","last_undegraded":"2024-09-16T16:56:43.155747+0000","last_fullsized":"2024-09-16T16:56:43.155747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.771195+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:56:43.771195+0000","last_peered":"2024-09-16T16:56:43.771195+0000","last_clean":"2024-09-16T16:56:43.771195+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:56:43.771195+0000","last_undegraded":"2024-09-16T16:56:43.771195+0000","last_fullsized":"2024-09-16T16:56:43.771195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'131","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.236033+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:56:43.236033+0000","last_peered":"2024-09-16T16:56:43.236033+0000","last_clean":"2024-09-16T16:56:43.236033+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:56:43.236033+0000","last_undegraded":"2024-09-16T16:56:43.236033+0000","last_fullsized":"2024-09-16T16:56:43.236033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"58'125","reported_seq":137,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.875747+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:56:43.875747+0000","last_peered":"2024-09-16T16:56:43.875747+0000","last_clean":"2024-09-16T16:56:43.875747+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:56:43.875747+0000","last_undegraded":"2024-09-16T16:56:43.875747+0000","last_fullsized":"2024-09-16T16:56:43.875747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.795024+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:56:43.795024+0000","last_peered":"2024-09-16T16:56:43.795024+0000","last_clean":"2024-09-16T16:56:43.795024+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:56:43.795024+0000","last_undegraded":"2024-09-16T16:56:43.795024+0000","last_fullsized":"2024-09-16T16:56:43.795024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.559085+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:56:43.559085+0000","last_peered":"2024-09-16T16:56:43.559085+0000","last_clean":"2024-09-16T16:56:43.559085+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:56:43.559085+0000","last_undegraded":"2024-09-16T16:56:43.559085+0000","last_fullsized":"2024-09-16T16:56:43.559085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.514051+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:56:43.514051+0000","last_peered":"2024-09-16T16:56:43.514051+0000","last_clean":"2024-09-16T16:56:43.514051+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:56:43.514051+0000","last_undegraded":"2024-09-16T16:56:43.514051+0000","last_fullsized":"2024-09-16T16:56:43.514051+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.804548+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:56:24.804548+0000","last_peered":"2024-09-16T16:56:24.804548+0000","last_clean":"2024-09-16T16:56:24.804548+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:56:24.804548+0000","last_undegraded":"2024-09-16T16:56:24.804548+0000","last_fullsized":"2024-09-16T16:56:24.804548+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.812059+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:56:24.812059+0000","last_peered":"2024-09-16T16:56:24.812059+0000","last_clean":"2024-09-16T16:56:24.812059+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:56:24.812059+0000","last_undegraded":"2024-09-16T16:56:24.812059+0000","last_fullsized":"2024-09-16T16:56:24.812059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"58'134","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.248469+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:56:43.248469+0000","last_peered":"2024-09-16T16:56:43.248469+0000","last_clean":"2024-09-16T16:56:43.248469+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:56:43.248469+0000","last_undegraded":"2024-09-16T16:56:43.248469+0000","last_fullsized":"2024-09-16T16:56:43.248469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808766+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:56:24.808766+0000","last_peered":"2024-09-16T16:56:24.808766+0000","last_clean":"2024-09-16T16:56:24.808766+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:56:24.808766+0000","last_undegraded":"2024-09-16T16:56:24.808766+0000","last_fullsized":"2024-09-16T16:56:24.808766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"58'151","reported_seq":163,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.780283+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:56:43.780283+0000","last_peered":"2024-09-16T16:56:43.780283+0000","last_clean":"2024-09-16T16:56:43.780283+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:56:43.780283+0000","last_undegraded":"2024-09-16T16:56:43.780283+0000","last_fullsized":"2024-09-16T16:56:43.780283+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809469+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:56:24.809469+0000","last_peered":"2024-09-16T16:56:24.809469+0000","last_clean":"2024-09-16T16:56:24.809469+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:56:24.809469+0000","last_undegraded":"2024-09-16T16:56:24.809469+0000","last_fullsized":"2024-09-16T16:56:24.809469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"58'124","reported_seq":136,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.653150+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:56:43.653150+0000","last_peered":"2024-09-16T16:56:43.653150+0000","last_clean":"2024-09-16T16:56:43.653150+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:56:43.653150+0000","last_undegraded":"2024-09-16T16:56:43.653150+0000","last_fullsized":"2024-09-16T16:56:43.653150+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808691+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:56:24.808691+0000","last_peered":"2024-09-16T16:56:24.808691+0000","last_clean":"2024-09-16T16:56:24.808691+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:56:24.808691+0000","last_undegraded":"2024-09-16T16:56:24.808691+0000","last_fullsized":"2024-09-16T16:56:24.808691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"58'135","reported_seq":147,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.871714+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:56:43.871714+0000","last_peered":"2024-09-16T16:56:43.871714+0000","last_clean":"2024-09-16T16:56:43.871714+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:56:43.871714+0000","last_undegraded":"2024-09-16T16:56:43.871714+0000","last_fullsized":"2024-09-16T16:56:43.871714+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809738+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:56:24.809738+0000","last_peered":"2024-09-16T16:56:24.809738+0000","last_clean":"2024-09-16T16:56:24.809738+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:56:24.809738+0000","last_undegraded":"2024-09-16T16:56:24.809738+0000","last_fullsized":"2024-09-16T16:56:24.809738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.638024+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:56:43.638024+0000","last_peered":"2024-09-16T16:56:43.638024+0000","last_clean":"2024-09-16T16:56:43.638024+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:56:43.638024+0000","last_undegraded":"2024-09-16T16:56:43.638024+0000","last_fullsized":"2024-09-16T16:56:43.638024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.807708+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:56:24.807708+0000","last_peered":"2024-09-16T16:56:24.807708+0000","last_clean":"2024-09-16T16:56:24.807708+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:56:24.807708+0000","last_undegraded":"2024-09-16T16:56:24.807708+0000","last_fullsized":"2024-09-16T16:56:24.807708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'118","reported_seq":130,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.546650+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:56:43.546650+0000","last_peered":"2024-09-16T16:56:43.546650+0000","last_clean":"2024-09-16T16:56:43.546650+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:56:43.546650+0000","last_undegraded":"2024-09-16T16:56:43.546650+0000","last_fullsized":"2024-09-16T16:56:43.546650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809437+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:56:24.809437+0000","last_peered":"2024-09-16T16:56:24.809437+0000","last_clean":"2024-09-16T16:56:24.809437+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:56:24.809437+0000","last_undegraded":"2024-09-16T16:56:24.809437+0000","last_fullsized":"2024-09-16T16:56:24.809437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"58'132","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.673093+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:56:43.673093+0000","last_peered":"2024-09-16T16:56:43.673093+0000","last_clean":"2024-09-16T16:56:43.673093+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:56:43.673093+0000","last_undegraded":"2024-09-16T16:56:43.673093+0000","last_fullsized":"2024-09-16T16:56:43.673093+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.814888+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:56:24.814888+0000","last_peered":"2024-09-16T16:56:24.814888+0000","last_clean":"2024-09-16T16:56:24.814888+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:56:24.814888+0000","last_undegraded":"2024-09-16T16:56:24.814888+0000","last_fullsized":"2024-09-16T16:56:24.814888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":140771328,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2148,"num_write_kb":137472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213353869312,"internally_reserved":0,"allocated":857624576,"data_stored":857624576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2148,"ondisk_log_size":2148,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213354147840,"internally_reserved":0,"allocated":857346048,"data_stored":857346048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":188640,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52109088,"statfs":{"total":53552873472,"available":53359706112,"internally_reserved":0,"allocated":193167360,"data_stored":193167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":192832,"kb_used_data":192832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52104896,"statfs":{"total":53552873472,"available":53355413504,"internally_reserved":0,"allocated":197459968,"data_stored":197459968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":218700,"kb_used_data":218700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52079028,"statfs":{"total":53552873472,"available":53328924672,"internally_reserved":0,"allocated":223948800,"data_stored":223948800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224704,"kb_used_data":224704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52073024,"statfs":{"total":53552873472,"available":53322776576,"internally_reserved":0,"allocated":230096896,"data_stored":230096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53322117120,"internally_reserved":0,"allocated":230756352,"data_stored":230756352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53323939840,"internally_reserved":0,"allocated":228933632,"data_stored":228933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53321969664,"internally_reserved":0,"allocated":230903808,"data_stored":230903808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53323808768,"internally_reserved":0,"allocated":229064704,"data_stored":229064704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:58.806 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:56:58.806 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:58.806 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:58.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:58.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 16 3789 3773 6.93499 7.0625 0.147633 0.143744 2024-09-16T16:56:58.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.951+0000 7f1977b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:58.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:58.963+0000 7f1977b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:59.079 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:59.083 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:59.084 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:59.084 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:59.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.222+0000 7f5775311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.238+0000 7f5775311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:59.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:59.269 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:59.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:59.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.472+0000 7f1c24d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.486+0000 7f1c24d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:59.678 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:59.678 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:59.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.839+0000 7f6b04791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:56:59.856+0000 7f6b04791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.868 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 3906 3890 6.94576 7.3125 0.0723775 0.143595 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:56:59.894 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:56:59.895 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:56:59.901 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:59.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:00.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 4003 3987 6.92121 6.0625 0.310375 0.144074 2024-09-16T16:57:01.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:01.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:01.378+0000 7fea01111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:01.386+0000 7fea01111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 4114 4098 6.92161 6.9375 0.0982486 0.14415 2024-09-16T16:57:02.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 4225 4209 6.92201 6.9375 0.184329 0.143947 2024-09-16T16:57:03.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:03.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 4331 4315 6.91438 6.625 0.0728773 0.144266 2024-09-16T16:57:04.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:04.031+0000 7fa56fb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:04.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:04.038+0000 7fa56fb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:04.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:57:04.869693+0000 min lat: 0.0228392 max lat: 0.666096 avg lat: 0.144506 2024-09-16T16:57:04.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:04.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 4431 4415 6.89775 6.25 0.11123 0.144506 2024-09-16T16:57:04.903 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:04.903 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:04.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:05.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:05.077+0000 7f8c08791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:05.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:05.094+0000 7f8c08791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:05.476 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:05.502 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-16T16:57:03.886514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":141361715,"num_objects":2152,"num_object_clones":0,"num_object_copies":6456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2229,"num_write_kb":138580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2203,"ondisk_log_size":2203,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":824876,"kb_used_data":824876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208366036,"statfs":{"total":214211493888,"available":213366820864,"internally_reserved":0,"allocated":844673024,"data_stored":844673024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001711"},"pg_stats":[{"pgid":"6.f","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.344180+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:56:43.344180+0000","last_peered":"2024-09-16T16:56:43.344180+0000","last_clean":"2024-09-16T16:56:43.344180+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:56:43.344180+0000","last_undegraded":"2024-09-16T16:56:43.344180+0000","last_fullsized":"2024-09-16T16:56:43.344180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.657912+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:56:43.657912+0000","last_peered":"2024-09-16T16:56:43.657912+0000","last_clean":"2024-09-16T16:56:43.657912+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:56:43.657912+0000","last_undegraded":"2024-09-16T16:56:43.657912+0000","last_fullsized":"2024-09-16T16:56:43.657912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.155747+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:56:43.155747+0000","last_peered":"2024-09-16T16:56:43.155747+0000","last_clean":"2024-09-16T16:56:43.155747+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:56:43.155747+0000","last_undegraded":"2024-09-16T16:56:43.155747+0000","last_fullsized":"2024-09-16T16:56:43.155747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.771195+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:56:43.771195+0000","last_peered":"2024-09-16T16:56:43.771195+0000","last_clean":"2024-09-16T16:56:43.771195+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:56:43.771195+0000","last_undegraded":"2024-09-16T16:56:43.771195+0000","last_fullsized":"2024-09-16T16:56:43.771195+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'131","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.236033+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:56:43.236033+0000","last_peered":"2024-09-16T16:56:43.236033+0000","last_clean":"2024-09-16T16:56:43.236033+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:56:43.236033+0000","last_undegraded":"2024-09-16T16:56:43.236033+0000","last_fullsized":"2024-09-16T16:56:43.236033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"58'125","reported_seq":137,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.875747+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:56:43.875747+0000","last_peered":"2024-09-16T16:56:43.875747+0000","last_clean":"2024-09-16T16:56:43.875747+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:56:43.875747+0000","last_undegraded":"2024-09-16T16:56:43.875747+0000","last_fullsized":"2024-09-16T16:56:43.875747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"58'130","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.795024+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:56:43.795024+0000","last_peered":"2024-09-16T16:56:43.795024+0000","last_clean":"2024-09-16T16:56:43.795024+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:56:43.795024+0000","last_undegraded":"2024-09-16T16:56:43.795024+0000","last_fullsized":"2024-09-16T16:56:43.795024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"58'127","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.559085+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:56:43.559085+0000","last_peered":"2024-09-16T16:56:43.559085+0000","last_clean":"2024-09-16T16:56:43.559085+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:56:43.559085+0000","last_undegraded":"2024-09-16T16:56:43.559085+0000","last_fullsized":"2024-09-16T16:56:43.559085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'142","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.514051+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:56:43.514051+0000","last_peered":"2024-09-16T16:56:43.514051+0000","last_clean":"2024-09-16T16:56:43.514051+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:56:43.514051+0000","last_undegraded":"2024-09-16T16:56:43.514051+0000","last_fullsized":"2024-09-16T16:56:43.514051+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.804548+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:56:24.804548+0000","last_peered":"2024-09-16T16:56:24.804548+0000","last_clean":"2024-09-16T16:56:24.804548+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:56:24.804548+0000","last_undegraded":"2024-09-16T16:56:24.804548+0000","last_fullsized":"2024-09-16T16:56:24.804548+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":143,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.812059+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:56:24.812059+0000","last_peered":"2024-09-16T16:56:24.812059+0000","last_clean":"2024-09-16T16:56:24.812059+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:56:24.812059+0000","last_undegraded":"2024-09-16T16:56:24.812059+0000","last_fullsized":"2024-09-16T16:56:24.812059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"58'134","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.248469+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:56:43.248469+0000","last_peered":"2024-09-16T16:56:43.248469+0000","last_clean":"2024-09-16T16:56:43.248469+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:56:43.248469+0000","last_undegraded":"2024-09-16T16:56:43.248469+0000","last_fullsized":"2024-09-16T16:56:43.248469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808766+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:56:24.808766+0000","last_peered":"2024-09-16T16:56:24.808766+0000","last_clean":"2024-09-16T16:56:24.808766+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:56:24.808766+0000","last_undegraded":"2024-09-16T16:56:24.808766+0000","last_fullsized":"2024-09-16T16:56:24.808766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"58'151","reported_seq":163,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.780283+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:56:43.780283+0000","last_peered":"2024-09-16T16:56:43.780283+0000","last_clean":"2024-09-16T16:56:43.780283+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:56:43.780283+0000","last_undegraded":"2024-09-16T16:56:43.780283+0000","last_fullsized":"2024-09-16T16:56:43.780283+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":9664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809469+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:56:24.809469+0000","last_peered":"2024-09-16T16:56:24.809469+0000","last_clean":"2024-09-16T16:56:24.809469+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:56:24.809469+0000","last_undegraded":"2024-09-16T16:56:24.809469+0000","last_fullsized":"2024-09-16T16:56:24.809469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"58'124","reported_seq":136,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.653150+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:56:43.653150+0000","last_peered":"2024-09-16T16:56:43.653150+0000","last_clean":"2024-09-16T16:56:43.653150+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:56:43.653150+0000","last_undegraded":"2024-09-16T16:56:43.653150+0000","last_fullsized":"2024-09-16T16:56:43.653150+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.808691+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:56:24.808691+0000","last_peered":"2024-09-16T16:56:24.808691+0000","last_clean":"2024-09-16T16:56:24.808691+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:56:24.808691+0000","last_undegraded":"2024-09-16T16:56:24.808691+0000","last_fullsized":"2024-09-16T16:56:24.808691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"58'135","reported_seq":147,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.871714+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:56:43.871714+0000","last_peered":"2024-09-16T16:56:43.871714+0000","last_clean":"2024-09-16T16:56:43.871714+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:56:43.871714+0000","last_undegraded":"2024-09-16T16:56:43.871714+0000","last_fullsized":"2024-09-16T16:56:43.871714+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809738+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:56:24.809738+0000","last_peered":"2024-09-16T16:56:24.809738+0000","last_clean":"2024-09-16T16:56:24.809738+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:56:24.809738+0000","last_undegraded":"2024-09-16T16:56:24.809738+0000","last_fullsized":"2024-09-16T16:56:24.809738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"58'150","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.638024+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:56:43.638024+0000","last_peered":"2024-09-16T16:56:43.638024+0000","last_clean":"2024-09-16T16:56:43.638024+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:56:43.638024+0000","last_undegraded":"2024-09-16T16:56:43.638024+0000","last_fullsized":"2024-09-16T16:56:43.638024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":9600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.807708+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:56:24.807708+0000","last_peered":"2024-09-16T16:56:24.807708+0000","last_clean":"2024-09-16T16:56:24.807708+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:56:24.807708+0000","last_undegraded":"2024-09-16T16:56:24.807708+0000","last_fullsized":"2024-09-16T16:56:24.807708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"58'118","reported_seq":130,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.546650+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:56:43.546650+0000","last_peered":"2024-09-16T16:56:43.546650+0000","last_clean":"2024-09-16T16:56:43.546650+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:56:43.546650+0000","last_undegraded":"2024-09-16T16:56:43.546650+0000","last_fullsized":"2024-09-16T16:56:43.546650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.809437+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:56:24.809437+0000","last_peered":"2024-09-16T16:56:24.809437+0000","last_clean":"2024-09-16T16:56:24.809437+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:56:24.809437+0000","last_undegraded":"2024-09-16T16:56:24.809437+0000","last_fullsized":"2024-09-16T16:56:24.809437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"58'132","reported_seq":144,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:43.673093+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:56:43.673093+0000","last_peered":"2024-09-16T16:56:43.673093+0000","last_clean":"2024-09-16T16:56:43.673093+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:56:43.673093+0000","last_undegraded":"2024-09-16T16:56:43.673093+0000","last_fullsized":"2024-09-16T16:56:43.673093+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.814888+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:56:24.814888+0000","last_peered":"2024-09-16T16:56:24.814888+0000","last_clean":"2024-09-16T16:56:24.814888+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:56:24.814888+0000","last_undegraded":"2024-09-16T16:56:24.814888+0000","last_fullsized":"2024-09-16T16:56:24.814888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":140771328,"num_objects":2148,"num_object_clones":0,"num_object_copies":6444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2148,"num_write_kb":137472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213353869312,"internally_reserved":0,"allocated":857624576,"data_stored":857624576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2148,"ondisk_log_size":2148,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213354147840,"internally_reserved":0,"allocated":857346048,"data_stored":857346048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":188640,"kb_used_data":188640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52109088,"statfs":{"total":53552873472,"available":53359706112,"internally_reserved":0,"allocated":193167360,"data_stored":193167360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":192832,"kb_used_data":192832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52104896,"statfs":{"total":53552873472,"available":53355413504,"internally_reserved":0,"allocated":197459968,"data_stored":197459968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":218700,"kb_used_data":218700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52079028,"statfs":{"total":53552873472,"available":53328924672,"internally_reserved":0,"allocated":223948800,"data_stored":223948800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":224704,"kb_used_data":224704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52073024,"statfs":{"total":53552873472,"available":53322776576,"internally_reserved":0,"allocated":230096896,"data_stored":230096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53322117120,"internally_reserved":0,"allocated":230756352,"data_stored":230756352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53323939840,"internally_reserved":0,"allocated":228933632,"data_stored":228933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53321969664,"internally_reserved":0,"allocated":230903808,"data_stored":230903808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53323808768,"internally_reserved":0,"allocated":229064704,"data_stored":229064704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53353832448,"internally_reserved":0,"allocated":199041024,"data_stored":199041024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53354258432,"internally_reserved":0,"allocated":198615040,"data_stored":198615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:05.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 4537 4521 6.89108 6.625 0.140487 0.144681 2024-09-16T16:57:06.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:06.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:06.793+0000 7f69bf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:06.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:06.799+0000 7f69bf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:06.869 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 4654 4638 6.9011 7.3125 0.185842 0.144554 2024-09-16T16:57:07.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 4763 4747 6.89902 6.8125 0.0620746 0.144561 2024-09-16T16:57:08.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 4880 4864 6.90841 7.3125 0.14851 0.144529 2024-09-16T16:57:09.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:09.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:09.565+0000 7f6f9ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:09.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:09.576+0000 7f6f9ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:09.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 4997 4981 6.91737 7.3125 0.0389025 0.144301 2024-09-16T16:57:10.503 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:10.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:57:10.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:10.664+0000 7f331af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:10.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:10.678+0000 7f331af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:10.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 5100 5084 6.90693 6.4375 0.040328 0.144396 2024-09-16T16:57:11.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 5225 5209 6.92618 7.8125 0.0739483 0.144195 2024-09-16T16:57:11.956 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:57:11.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:57:12.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:12.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:12.142+0000 7f2e82f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:12.158+0000 7f2e82f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:12.257+0000 7f893f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:12.267+0000 7f893f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 5323 5307 6.90947 6.125 0.182815 0.144462 2024-09-16T16:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:57:12.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:57:13.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:13.169+0000 7fee0e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:13.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:13.187+0000 7fee0e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:13.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 5431 5415 6.90621 6.75 0.124039 0.144618 2024-09-16T16:57:13.969 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:57:13.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:57:14.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:14.151+0000 7fde95d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:14.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:14.168+0000 7fde95d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:14.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:14.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 5533 5517 6.89557 6.375 0.102832 0.144625 2024-09-16T16:57:14.971 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:57:14.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:14.968+0000 7f4bf5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:14.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:14.985+0000 7f4bf5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:15.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:57:15.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:15.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:15.191+0000 7fb4b32bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:15.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:15.205+0000 7fb4b32bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:15.586 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:15.587 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:15.611 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-16T16:57:14.975237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":356057651,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5505,"num_write_kb":348244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5479,"ondisk_log_size":5479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2087128,"kb_used_data":2087128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207103784,"statfs":{"total":214211493888,"available":212074274816,"internally_reserved":0,"allocated":2137219072,"data_stored":2137219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":214695936,"num_objects":3276,"num_object_clones":0,"num_object_copies":9828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3276,"num_write_kb":209664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.087396"},"pg_stats":[{"pgid":"6.f","version":"64'364","reported_seq":394,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.657540+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:13.657540+0000","last_peered":"2024-09-16T16:57:13.657540+0000","last_clean":"2024-09-16T16:57:13.657540+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:13.657540+0000","last_undegraded":"2024-09-16T16:57:13.657540+0000","last_fullsized":"2024-09-16T16:57:13.657540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"64'338","reported_seq":368,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.641023+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:13.641023+0000","last_peered":"2024-09-16T16:57:13.641023+0000","last_clean":"2024-09-16T16:57:13.641023+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:13.641023+0000","last_undegraded":"2024-09-16T16:57:13.641023+0000","last_fullsized":"2024-09-16T16:57:13.641023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":338,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"64'343","reported_seq":373,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.447264+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:13.447264+0000","last_peered":"2024-09-16T16:57:13.447264+0000","last_clean":"2024-09-16T16:57:13.447264+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:13.447264+0000","last_undegraded":"2024-09-16T16:57:13.447264+0000","last_fullsized":"2024-09-16T16:57:13.447264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"64'360","reported_seq":390,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756448+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:13.756448+0000","last_peered":"2024-09-16T16:57:13.756448+0000","last_clean":"2024-09-16T16:57:13.756448+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:13.756448+0000","last_undegraded":"2024-09-16T16:57:13.756448+0000","last_fullsized":"2024-09-16T16:57:13.756448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"64'345","reported_seq":375,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.546886+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:13.546886+0000","last_peered":"2024-09-16T16:57:13.546886+0000","last_clean":"2024-09-16T16:57:13.546886+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:13.546886+0000","last_undegraded":"2024-09-16T16:57:13.546886+0000","last_fullsized":"2024-09-16T16:57:13.546886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"64'346","reported_seq":376,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.786469+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:13.786469+0000","last_peered":"2024-09-16T16:57:13.786469+0000","last_clean":"2024-09-16T16:57:13.786469+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:13.786469+0000","last_undegraded":"2024-09-16T16:57:13.786469+0000","last_fullsized":"2024-09-16T16:57:13.786469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"64'336","reported_seq":366,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.530684+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:13.530684+0000","last_peered":"2024-09-16T16:57:13.530684+0000","last_clean":"2024-09-16T16:57:13.530684+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:13.530684+0000","last_undegraded":"2024-09-16T16:57:13.530684+0000","last_fullsized":"2024-09-16T16:57:13.530684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"64'330","reported_seq":360,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.677939+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:13.677939+0000","last_peered":"2024-09-16T16:57:13.677939+0000","last_clean":"2024-09-16T16:57:13.677939+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:13.677939+0000","last_undegraded":"2024-09-16T16:57:13.677939+0000","last_fullsized":"2024-09-16T16:57:13.677939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.172112+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:13.172112+0000","last_peered":"2024-09-16T16:57:13.172112+0000","last_clean":"2024-09-16T16:57:13.172112+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:13.172112+0000","last_undegraded":"2024-09-16T16:57:13.172112+0000","last_fullsized":"2024-09-16T16:57:13.172112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.020711+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:13.020711+0000","last_peered":"2024-09-16T16:57:13.020711+0000","last_clean":"2024-09-16T16:57:13.020711+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:13.020711+0000","last_undegraded":"2024-09-16T16:57:13.020711+0000","last_fullsized":"2024-09-16T16:57:13.020711+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.052866+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:13.052866+0000","last_peered":"2024-09-16T16:57:13.052866+0000","last_clean":"2024-09-16T16:57:13.052866+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:13.052866+0000","last_undegraded":"2024-09-16T16:57:13.052866+0000","last_fullsized":"2024-09-16T16:57:13.052866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"64'331","reported_seq":361,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.230771+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:13.230771+0000","last_peered":"2024-09-16T16:57:13.230771+0000","last_clean":"2024-09-16T16:57:13.230771+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:13.230771+0000","last_undegraded":"2024-09-16T16:57:13.230771+0000","last_fullsized":"2024-09-16T16:57:13.230771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.164621+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:13.164621+0000","last_peered":"2024-09-16T16:57:13.164621+0000","last_clean":"2024-09-16T16:57:13.164621+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:13.164621+0000","last_undegraded":"2024-09-16T16:57:13.164621+0000","last_fullsized":"2024-09-16T16:57:13.164621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"64'365","reported_seq":395,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756996+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:13.756996+0000","last_peered":"2024-09-16T16:57:13.756996+0000","last_clean":"2024-09-16T16:57:13.756996+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:13.756996+0000","last_undegraded":"2024-09-16T16:57:13.756996+0000","last_fullsized":"2024-09-16T16:57:13.756996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.049461+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:13.049461+0000","last_peered":"2024-09-16T16:57:13.049461+0000","last_clean":"2024-09-16T16:57:13.049461+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:13.049461+0000","last_undegraded":"2024-09-16T16:57:13.049461+0000","last_fullsized":"2024-09-16T16:57:13.049461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"64'329","reported_seq":359,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.309016+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:13.309016+0000","last_peered":"2024-09-16T16:57:13.309016+0000","last_clean":"2024-09-16T16:57:13.309016+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:13.309016+0000","last_undegraded":"2024-09-16T16:57:13.309016+0000","last_fullsized":"2024-09-16T16:57:13.309016+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.166570+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:13.166570+0000","last_peered":"2024-09-16T16:57:13.166570+0000","last_clean":"2024-09-16T16:57:13.166570+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:13.166570+0000","last_undegraded":"2024-09-16T16:57:13.166570+0000","last_fullsized":"2024-09-16T16:57:13.166570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"64'341","reported_seq":371,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.799068+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:13.799068+0000","last_peered":"2024-09-16T16:57:13.799068+0000","last_clean":"2024-09-16T16:57:13.799068+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:13.799068+0000","last_undegraded":"2024-09-16T16:57:13.799068+0000","last_fullsized":"2024-09-16T16:57:13.799068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.111615+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:13.111615+0000","last_peered":"2024-09-16T16:57:13.111615+0000","last_clean":"2024-09-16T16:57:13.111615+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:13.111615+0000","last_undegraded":"2024-09-16T16:57:13.111615+0000","last_fullsized":"2024-09-16T16:57:13.111615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.782832+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:13.782832+0000","last_peered":"2024-09-16T16:57:13.782832+0000","last_clean":"2024-09-16T16:57:13.782832+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:13.782832+0000","last_undegraded":"2024-09-16T16:57:13.782832+0000","last_fullsized":"2024-09-16T16:57:13.782832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.038331+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:13.038331+0000","last_peered":"2024-09-16T16:57:13.038331+0000","last_clean":"2024-09-16T16:57:13.038331+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:13.038331+0000","last_undegraded":"2024-09-16T16:57:13.038331+0000","last_fullsized":"2024-09-16T16:57:13.038331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"64'320","reported_seq":350,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.063359+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:13.063359+0000","last_peered":"2024-09-16T16:57:13.063359+0000","last_clean":"2024-09-16T16:57:13.063359+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:13.063359+0000","last_undegraded":"2024-09-16T16:57:13.063359+0000","last_fullsized":"2024-09-16T16:57:13.063359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.110891+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:13.110891+0000","last_peered":"2024-09-16T16:57:13.110891+0000","last_clean":"2024-09-16T16:57:13.110891+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:13.110891+0000","last_undegraded":"2024-09-16T16:57:13.110891+0000","last_fullsized":"2024-09-16T16:57:13.110891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"64'312","reported_seq":342,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.462601+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:13.462601+0000","last_peered":"2024-09-16T16:57:13.462601+0000","last_clean":"2024-09-16T16:57:13.462601+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:13.462601+0000","last_undegraded":"2024-09-16T16:57:13.462601+0000","last_fullsized":"2024-09-16T16:57:13.462601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.053609+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:13.053609+0000","last_peered":"2024-09-16T16:57:13.053609+0000","last_clean":"2024-09-16T16:57:13.053609+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:13.053609+0000","last_undegraded":"2024-09-16T16:57:13.053609+0000","last_fullsized":"2024-09-16T16:57:13.053609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":347136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5424,"ondisk_log_size":5424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":479524,"kb_used_data":479524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51818204,"statfs":{"total":53552873472,"available":53061840896,"internally_reserved":0,"allocated":491032576,"data_stored":491032576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489032,"kb_used_data":489032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808696,"statfs":{"total":53552873472,"available":53052104704,"internally_reserved":0,"allocated":500768768,"data_stored":500768768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562772,"kb_used_data":562772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734956,"statfs":{"total":53552873472,"available":52976594944,"internally_reserved":0,"allocated":576278528,"data_stored":576278528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555800,"kb_used_data":555800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741928,"statfs":{"total":53552873472,"available":52983734272,"internally_reserved":0,"allocated":569139200,"data_stored":569139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:15.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:15.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:15.778+0000 7f2bedd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:15.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:15.794+0000 7f2bedd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:15.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 5631 5615 6.88045 6.125 0.166959 0.145043 2024-09-16T16:57:16.087 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:16.087 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:16.113 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-16T16:57:15.889116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":356057651,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5505,"num_write_kb":348244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5479,"ondisk_log_size":5479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2087128,"kb_used_data":2087128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207103784,"statfs":{"total":214211493888,"available":212074274816,"internally_reserved":0,"allocated":2137219072,"data_stored":2137219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":214695936,"num_objects":3276,"num_object_clones":0,"num_object_copies":9828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3276,"num_write_kb":209664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000863"},"pg_stats":[{"pgid":"6.f","version":"64'364","reported_seq":394,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.657540+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:13.657540+0000","last_peered":"2024-09-16T16:57:13.657540+0000","last_clean":"2024-09-16T16:57:13.657540+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:13.657540+0000","last_undegraded":"2024-09-16T16:57:13.657540+0000","last_fullsized":"2024-09-16T16:57:13.657540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"64'338","reported_seq":368,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.641023+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:13.641023+0000","last_peered":"2024-09-16T16:57:13.641023+0000","last_clean":"2024-09-16T16:57:13.641023+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:13.641023+0000","last_undegraded":"2024-09-16T16:57:13.641023+0000","last_fullsized":"2024-09-16T16:57:13.641023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":338,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"64'343","reported_seq":373,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.447264+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:13.447264+0000","last_peered":"2024-09-16T16:57:13.447264+0000","last_clean":"2024-09-16T16:57:13.447264+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:13.447264+0000","last_undegraded":"2024-09-16T16:57:13.447264+0000","last_fullsized":"2024-09-16T16:57:13.447264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"64'360","reported_seq":390,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756448+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:13.756448+0000","last_peered":"2024-09-16T16:57:13.756448+0000","last_clean":"2024-09-16T16:57:13.756448+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:13.756448+0000","last_undegraded":"2024-09-16T16:57:13.756448+0000","last_fullsized":"2024-09-16T16:57:13.756448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"64'345","reported_seq":375,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.546886+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:13.546886+0000","last_peered":"2024-09-16T16:57:13.546886+0000","last_clean":"2024-09-16T16:57:13.546886+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:13.546886+0000","last_undegraded":"2024-09-16T16:57:13.546886+0000","last_fullsized":"2024-09-16T16:57:13.546886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"64'346","reported_seq":376,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.786469+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:13.786469+0000","last_peered":"2024-09-16T16:57:13.786469+0000","last_clean":"2024-09-16T16:57:13.786469+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:13.786469+0000","last_undegraded":"2024-09-16T16:57:13.786469+0000","last_fullsized":"2024-09-16T16:57:13.786469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"64'336","reported_seq":366,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.530684+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:13.530684+0000","last_peered":"2024-09-16T16:57:13.530684+0000","last_clean":"2024-09-16T16:57:13.530684+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:13.530684+0000","last_undegraded":"2024-09-16T16:57:13.530684+0000","last_fullsized":"2024-09-16T16:57:13.530684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"64'330","reported_seq":360,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.677939+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:13.677939+0000","last_peered":"2024-09-16T16:57:13.677939+0000","last_clean":"2024-09-16T16:57:13.677939+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:13.677939+0000","last_undegraded":"2024-09-16T16:57:13.677939+0000","last_fullsized":"2024-09-16T16:57:13.677939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.172112+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:13.172112+0000","last_peered":"2024-09-16T16:57:13.172112+0000","last_clean":"2024-09-16T16:57:13.172112+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:13.172112+0000","last_undegraded":"2024-09-16T16:57:13.172112+0000","last_fullsized":"2024-09-16T16:57:13.172112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.020711+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:13.020711+0000","last_peered":"2024-09-16T16:57:13.020711+0000","last_clean":"2024-09-16T16:57:13.020711+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:13.020711+0000","last_undegraded":"2024-09-16T16:57:13.020711+0000","last_fullsized":"2024-09-16T16:57:13.020711+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.052866+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:13.052866+0000","last_peered":"2024-09-16T16:57:13.052866+0000","last_clean":"2024-09-16T16:57:13.052866+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:13.052866+0000","last_undegraded":"2024-09-16T16:57:13.052866+0000","last_fullsized":"2024-09-16T16:57:13.052866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"64'331","reported_seq":361,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.230771+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:13.230771+0000","last_peered":"2024-09-16T16:57:13.230771+0000","last_clean":"2024-09-16T16:57:13.230771+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:13.230771+0000","last_undegraded":"2024-09-16T16:57:13.230771+0000","last_fullsized":"2024-09-16T16:57:13.230771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.164621+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:13.164621+0000","last_peered":"2024-09-16T16:57:13.164621+0000","last_clean":"2024-09-16T16:57:13.164621+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:13.164621+0000","last_undegraded":"2024-09-16T16:57:13.164621+0000","last_fullsized":"2024-09-16T16:57:13.164621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"64'365","reported_seq":395,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756996+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:13.756996+0000","last_peered":"2024-09-16T16:57:13.756996+0000","last_clean":"2024-09-16T16:57:13.756996+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:13.756996+0000","last_undegraded":"2024-09-16T16:57:13.756996+0000","last_fullsized":"2024-09-16T16:57:13.756996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.049461+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:13.049461+0000","last_peered":"2024-09-16T16:57:13.049461+0000","last_clean":"2024-09-16T16:57:13.049461+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:13.049461+0000","last_undegraded":"2024-09-16T16:57:13.049461+0000","last_fullsized":"2024-09-16T16:57:13.049461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"64'329","reported_seq":359,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.309016+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:13.309016+0000","last_peered":"2024-09-16T16:57:13.309016+0000","last_clean":"2024-09-16T16:57:13.309016+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:13.309016+0000","last_undegraded":"2024-09-16T16:57:13.309016+0000","last_fullsized":"2024-09-16T16:57:13.309016+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.166570+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:13.166570+0000","last_peered":"2024-09-16T16:57:13.166570+0000","last_clean":"2024-09-16T16:57:13.166570+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:13.166570+0000","last_undegraded":"2024-09-16T16:57:13.166570+0000","last_fullsized":"2024-09-16T16:57:13.166570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"64'341","reported_seq":371,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.799068+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:13.799068+0000","last_peered":"2024-09-16T16:57:13.799068+0000","last_clean":"2024-09-16T16:57:13.799068+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:13.799068+0000","last_undegraded":"2024-09-16T16:57:13.799068+0000","last_fullsized":"2024-09-16T16:57:13.799068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.111615+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:13.111615+0000","last_peered":"2024-09-16T16:57:13.111615+0000","last_clean":"2024-09-16T16:57:13.111615+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:13.111615+0000","last_undegraded":"2024-09-16T16:57:13.111615+0000","last_fullsized":"2024-09-16T16:57:13.111615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.782832+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:13.782832+0000","last_peered":"2024-09-16T16:57:13.782832+0000","last_clean":"2024-09-16T16:57:13.782832+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:13.782832+0000","last_undegraded":"2024-09-16T16:57:13.782832+0000","last_fullsized":"2024-09-16T16:57:13.782832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.038331+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:13.038331+0000","last_peered":"2024-09-16T16:57:13.038331+0000","last_clean":"2024-09-16T16:57:13.038331+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:13.038331+0000","last_undegraded":"2024-09-16T16:57:13.038331+0000","last_fullsized":"2024-09-16T16:57:13.038331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"64'320","reported_seq":350,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.063359+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:13.063359+0000","last_peered":"2024-09-16T16:57:13.063359+0000","last_clean":"2024-09-16T16:57:13.063359+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:13.063359+0000","last_undegraded":"2024-09-16T16:57:13.063359+0000","last_fullsized":"2024-09-16T16:57:13.063359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.110891+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:13.110891+0000","last_peered":"2024-09-16T16:57:13.110891+0000","last_clean":"2024-09-16T16:57:13.110891+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:13.110891+0000","last_undegraded":"2024-09-16T16:57:13.110891+0000","last_fullsized":"2024-09-16T16:57:13.110891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"64'312","reported_seq":342,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.462601+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:13.462601+0000","last_peered":"2024-09-16T16:57:13.462601+0000","last_clean":"2024-09-16T16:57:13.462601+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:13.462601+0000","last_undegraded":"2024-09-16T16:57:13.462601+0000","last_fullsized":"2024-09-16T16:57:13.462601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.053609+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:13.053609+0000","last_peered":"2024-09-16T16:57:13.053609+0000","last_clean":"2024-09-16T16:57:13.053609+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:13.053609+0000","last_undegraded":"2024-09-16T16:57:13.053609+0000","last_fullsized":"2024-09-16T16:57:13.053609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":347136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5424,"ondisk_log_size":5424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":479524,"kb_used_data":479524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51818204,"statfs":{"total":53552873472,"available":53061840896,"internally_reserved":0,"allocated":491032576,"data_stored":491032576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489032,"kb_used_data":489032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808696,"statfs":{"total":53552873472,"available":53052104704,"internally_reserved":0,"allocated":500768768,"data_stored":500768768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562772,"kb_used_data":562772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734956,"statfs":{"total":53552873472,"available":52976594944,"internally_reserved":0,"allocated":576278528,"data_stored":576278528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555800,"kb_used_data":555800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741928,"statfs":{"total":53552873472,"available":52983734272,"internally_reserved":0,"allocated":569139200,"data_stored":569139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:16.114 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:57:16.114 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:16.114 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:16.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:16.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:16.290+0000 7fd01cf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:16.310+0000 7fd01cf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:16.463 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:16.463 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:16.463 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:16.464 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:16.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:16.469 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:16.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:16.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:16.650+0000 7f432fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:16.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:16.670+0000 7f432fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:16.834 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:16.834 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:16.834 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:16.835 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:16.841 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:16.841 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:16.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:16.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 5747 5731 6.88754 7.25 0.0717548 0.144962 2024-09-16T16:57:17.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.023+0000 7fb7734d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.042+0000 7fb7734d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:17.160 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:17.160 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:17.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:17.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.387+0000 7f8fc22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.407+0000 7f8fc22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:17.436 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:17.437 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:17.441 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:17.442 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:17.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.673+0000 7f5a676bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:17.683+0000 7f5a676bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.870 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 5860 5844 6.89083 7.0625 0.101429 0.144844 2024-09-16T16:57:18.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 5969 5953 6.88936 6.8125 0.0979746 0.144877 2024-09-16T16:57:19.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 6080 6064 6.89022 6.9375 0.0921148 0.144845 2024-09-16T16:57:20.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:20.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:20.481+0000 7fea75511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:20.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:20.492+0000 7fea75511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:20.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 6185 6169 6.88436 6.5625 0.0920049 0.145032 2024-09-16T16:57:21.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 6284 6268 6.87212 6.1875 0.130003 0.145207 2024-09-16T16:57:22.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:22.443 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:57:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:22.578+0000 7f342d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:22.596+0000 7f342d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:22.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 6384 6368 6.86139 6.25 0.118186 0.145525 2024-09-16T16:57:22.996 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:23.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:23.147+0000 7f30f54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:23.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:23.156+0000 7f30f54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:23.741 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:57:23.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:57:23.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 6479 6463 6.84572 5.9375 0.142749 0.145677 2024-09-16T16:57:23.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:23.914+0000 7fbb5b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:23.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:23.928+0000 7fbb5b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:57:24.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:57:24.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:57:24.871714+0000 min lat: 0.0228392 max lat: 0.666096 avg lat: 0.146017 2024-09-16T16:57:24.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:24.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 6581 6565 6.83786 6.375 0.133087 0.146017 2024-09-16T16:57:24.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:24.933+0000 7fa679f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:24.953+0000 7fa679f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:25.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:25.758 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:57:25.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:57:25.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:25.854+0000 7fb84af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:25.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:25.868+0000 7fb84af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:25.871 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 6680 6664 6.82717 6.1875 0.122218 0.146185 2024-09-16T16:57:25.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:25.962+0000 7fe05e2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:25.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:25.979+0000 7fe05e2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:26.733 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:57:26.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:57:26.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:26.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 6765 6749 6.80273 5.3125 0.1446 0.146679 2024-09-16T16:57:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:26.903+0000 7f73b3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:26.915+0000 7f73b3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:27.292 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:27.292 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:27.311 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-16T16:57:26.733409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":356057651,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5505,"num_write_kb":348244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5479,"ondisk_log_size":5479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2087128,"kb_used_data":2087128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207103784,"statfs":{"total":214211493888,"available":212074274816,"internally_reserved":0,"allocated":2137219072,"data_stored":2137219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.842898"},"pg_stats":[{"pgid":"6.f","version":"64'364","reported_seq":394,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.657540+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:13.657540+0000","last_peered":"2024-09-16T16:57:13.657540+0000","last_clean":"2024-09-16T16:57:13.657540+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:13.657540+0000","last_undegraded":"2024-09-16T16:57:13.657540+0000","last_fullsized":"2024-09-16T16:57:13.657540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"64'338","reported_seq":368,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.641023+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:13.641023+0000","last_peered":"2024-09-16T16:57:13.641023+0000","last_clean":"2024-09-16T16:57:13.641023+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:13.641023+0000","last_undegraded":"2024-09-16T16:57:13.641023+0000","last_fullsized":"2024-09-16T16:57:13.641023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":338,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"64'343","reported_seq":373,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.447264+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:13.447264+0000","last_peered":"2024-09-16T16:57:13.447264+0000","last_clean":"2024-09-16T16:57:13.447264+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:13.447264+0000","last_undegraded":"2024-09-16T16:57:13.447264+0000","last_fullsized":"2024-09-16T16:57:13.447264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"64'360","reported_seq":390,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756448+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:13.756448+0000","last_peered":"2024-09-16T16:57:13.756448+0000","last_clean":"2024-09-16T16:57:13.756448+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:13.756448+0000","last_undegraded":"2024-09-16T16:57:13.756448+0000","last_fullsized":"2024-09-16T16:57:13.756448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"64'345","reported_seq":375,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.546886+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:13.546886+0000","last_peered":"2024-09-16T16:57:13.546886+0000","last_clean":"2024-09-16T16:57:13.546886+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:13.546886+0000","last_undegraded":"2024-09-16T16:57:13.546886+0000","last_fullsized":"2024-09-16T16:57:13.546886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"64'346","reported_seq":376,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.786469+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:13.786469+0000","last_peered":"2024-09-16T16:57:13.786469+0000","last_clean":"2024-09-16T16:57:13.786469+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:13.786469+0000","last_undegraded":"2024-09-16T16:57:13.786469+0000","last_fullsized":"2024-09-16T16:57:13.786469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"64'336","reported_seq":366,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.530684+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:13.530684+0000","last_peered":"2024-09-16T16:57:13.530684+0000","last_clean":"2024-09-16T16:57:13.530684+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:13.530684+0000","last_undegraded":"2024-09-16T16:57:13.530684+0000","last_fullsized":"2024-09-16T16:57:13.530684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"64'330","reported_seq":360,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.677939+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:13.677939+0000","last_peered":"2024-09-16T16:57:13.677939+0000","last_clean":"2024-09-16T16:57:13.677939+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:13.677939+0000","last_undegraded":"2024-09-16T16:57:13.677939+0000","last_fullsized":"2024-09-16T16:57:13.677939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.172112+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:13.172112+0000","last_peered":"2024-09-16T16:57:13.172112+0000","last_clean":"2024-09-16T16:57:13.172112+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:13.172112+0000","last_undegraded":"2024-09-16T16:57:13.172112+0000","last_fullsized":"2024-09-16T16:57:13.172112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.020711+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:13.020711+0000","last_peered":"2024-09-16T16:57:13.020711+0000","last_clean":"2024-09-16T16:57:13.020711+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:13.020711+0000","last_undegraded":"2024-09-16T16:57:13.020711+0000","last_fullsized":"2024-09-16T16:57:13.020711+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.052866+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:13.052866+0000","last_peered":"2024-09-16T16:57:13.052866+0000","last_clean":"2024-09-16T16:57:13.052866+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:13.052866+0000","last_undegraded":"2024-09-16T16:57:13.052866+0000","last_fullsized":"2024-09-16T16:57:13.052866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"64'331","reported_seq":361,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.230771+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:13.230771+0000","last_peered":"2024-09-16T16:57:13.230771+0000","last_clean":"2024-09-16T16:57:13.230771+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:13.230771+0000","last_undegraded":"2024-09-16T16:57:13.230771+0000","last_fullsized":"2024-09-16T16:57:13.230771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.164621+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:13.164621+0000","last_peered":"2024-09-16T16:57:13.164621+0000","last_clean":"2024-09-16T16:57:13.164621+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:13.164621+0000","last_undegraded":"2024-09-16T16:57:13.164621+0000","last_fullsized":"2024-09-16T16:57:13.164621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"64'365","reported_seq":395,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756996+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:13.756996+0000","last_peered":"2024-09-16T16:57:13.756996+0000","last_clean":"2024-09-16T16:57:13.756996+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:13.756996+0000","last_undegraded":"2024-09-16T16:57:13.756996+0000","last_fullsized":"2024-09-16T16:57:13.756996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.049461+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:13.049461+0000","last_peered":"2024-09-16T16:57:13.049461+0000","last_clean":"2024-09-16T16:57:13.049461+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:13.049461+0000","last_undegraded":"2024-09-16T16:57:13.049461+0000","last_fullsized":"2024-09-16T16:57:13.049461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"64'329","reported_seq":359,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.309016+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:13.309016+0000","last_peered":"2024-09-16T16:57:13.309016+0000","last_clean":"2024-09-16T16:57:13.309016+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:13.309016+0000","last_undegraded":"2024-09-16T16:57:13.309016+0000","last_fullsized":"2024-09-16T16:57:13.309016+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.166570+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:13.166570+0000","last_peered":"2024-09-16T16:57:13.166570+0000","last_clean":"2024-09-16T16:57:13.166570+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:13.166570+0000","last_undegraded":"2024-09-16T16:57:13.166570+0000","last_fullsized":"2024-09-16T16:57:13.166570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"64'341","reported_seq":371,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.799068+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:13.799068+0000","last_peered":"2024-09-16T16:57:13.799068+0000","last_clean":"2024-09-16T16:57:13.799068+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:13.799068+0000","last_undegraded":"2024-09-16T16:57:13.799068+0000","last_fullsized":"2024-09-16T16:57:13.799068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.111615+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:13.111615+0000","last_peered":"2024-09-16T16:57:13.111615+0000","last_clean":"2024-09-16T16:57:13.111615+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:13.111615+0000","last_undegraded":"2024-09-16T16:57:13.111615+0000","last_fullsized":"2024-09-16T16:57:13.111615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.782832+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:13.782832+0000","last_peered":"2024-09-16T16:57:13.782832+0000","last_clean":"2024-09-16T16:57:13.782832+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:13.782832+0000","last_undegraded":"2024-09-16T16:57:13.782832+0000","last_fullsized":"2024-09-16T16:57:13.782832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.038331+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:13.038331+0000","last_peered":"2024-09-16T16:57:13.038331+0000","last_clean":"2024-09-16T16:57:13.038331+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:13.038331+0000","last_undegraded":"2024-09-16T16:57:13.038331+0000","last_fullsized":"2024-09-16T16:57:13.038331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"64'320","reported_seq":350,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.063359+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:13.063359+0000","last_peered":"2024-09-16T16:57:13.063359+0000","last_clean":"2024-09-16T16:57:13.063359+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:13.063359+0000","last_undegraded":"2024-09-16T16:57:13.063359+0000","last_fullsized":"2024-09-16T16:57:13.063359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.110891+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:13.110891+0000","last_peered":"2024-09-16T16:57:13.110891+0000","last_clean":"2024-09-16T16:57:13.110891+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:13.110891+0000","last_undegraded":"2024-09-16T16:57:13.110891+0000","last_fullsized":"2024-09-16T16:57:13.110891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"64'312","reported_seq":342,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.462601+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:13.462601+0000","last_peered":"2024-09-16T16:57:13.462601+0000","last_clean":"2024-09-16T16:57:13.462601+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:13.462601+0000","last_undegraded":"2024-09-16T16:57:13.462601+0000","last_fullsized":"2024-09-16T16:57:13.462601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.053609+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:13.053609+0000","last_peered":"2024-09-16T16:57:13.053609+0000","last_clean":"2024-09-16T16:57:13.053609+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:13.053609+0000","last_undegraded":"2024-09-16T16:57:13.053609+0000","last_fullsized":"2024-09-16T16:57:13.053609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":347136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5424,"ondisk_log_size":5424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":479524,"kb_used_data":479524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51818204,"statfs":{"total":53552873472,"available":53061840896,"internally_reserved":0,"allocated":491032576,"data_stored":491032576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489032,"kb_used_data":489032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808696,"statfs":{"total":53552873472,"available":53052104704,"internally_reserved":0,"allocated":500768768,"data_stored":500768768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562772,"kb_used_data":562772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734956,"statfs":{"total":53552873472,"available":52976594944,"internally_reserved":0,"allocated":576278528,"data_stored":576278528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555800,"kb_used_data":555800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741928,"statfs":{"total":53552873472,"available":52983734272,"internally_reserved":0,"allocated":569139200,"data_stored":569139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:27.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:27.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:27.443+0000 7fe7b0a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:27.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:27.453+0000 7fe7b0a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:27.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:27.731 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-16T16:57:26.733409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":356057651,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5505,"num_write_kb":348244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5479,"ondisk_log_size":5479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2087128,"kb_used_data":2087128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207103784,"statfs":{"total":214211493888,"available":212074274816,"internally_reserved":0,"allocated":2137219072,"data_stored":2137219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.842898"},"pg_stats":[{"pgid":"6.f","version":"64'364","reported_seq":394,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.657540+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:13.657540+0000","last_peered":"2024-09-16T16:57:13.657540+0000","last_clean":"2024-09-16T16:57:13.657540+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:13.657540+0000","last_undegraded":"2024-09-16T16:57:13.657540+0000","last_fullsized":"2024-09-16T16:57:13.657540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"64'338","reported_seq":368,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.641023+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:13.641023+0000","last_peered":"2024-09-16T16:57:13.641023+0000","last_clean":"2024-09-16T16:57:13.641023+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:13.641023+0000","last_undegraded":"2024-09-16T16:57:13.641023+0000","last_fullsized":"2024-09-16T16:57:13.641023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":338,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"64'343","reported_seq":373,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.447264+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:13.447264+0000","last_peered":"2024-09-16T16:57:13.447264+0000","last_clean":"2024-09-16T16:57:13.447264+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:13.447264+0000","last_undegraded":"2024-09-16T16:57:13.447264+0000","last_fullsized":"2024-09-16T16:57:13.447264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"64'360","reported_seq":390,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756448+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:13.756448+0000","last_peered":"2024-09-16T16:57:13.756448+0000","last_clean":"2024-09-16T16:57:13.756448+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:13.756448+0000","last_undegraded":"2024-09-16T16:57:13.756448+0000","last_fullsized":"2024-09-16T16:57:13.756448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"64'345","reported_seq":375,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.546886+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:13.546886+0000","last_peered":"2024-09-16T16:57:13.546886+0000","last_clean":"2024-09-16T16:57:13.546886+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:13.546886+0000","last_undegraded":"2024-09-16T16:57:13.546886+0000","last_fullsized":"2024-09-16T16:57:13.546886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"64'346","reported_seq":376,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.786469+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:13.786469+0000","last_peered":"2024-09-16T16:57:13.786469+0000","last_clean":"2024-09-16T16:57:13.786469+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:13.786469+0000","last_undegraded":"2024-09-16T16:57:13.786469+0000","last_fullsized":"2024-09-16T16:57:13.786469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"64'336","reported_seq":366,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.530684+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:13.530684+0000","last_peered":"2024-09-16T16:57:13.530684+0000","last_clean":"2024-09-16T16:57:13.530684+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:13.530684+0000","last_undegraded":"2024-09-16T16:57:13.530684+0000","last_fullsized":"2024-09-16T16:57:13.530684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"64'330","reported_seq":360,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.677939+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:13.677939+0000","last_peered":"2024-09-16T16:57:13.677939+0000","last_clean":"2024-09-16T16:57:13.677939+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:13.677939+0000","last_undegraded":"2024-09-16T16:57:13.677939+0000","last_fullsized":"2024-09-16T16:57:13.677939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.172112+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:13.172112+0000","last_peered":"2024-09-16T16:57:13.172112+0000","last_clean":"2024-09-16T16:57:13.172112+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:13.172112+0000","last_undegraded":"2024-09-16T16:57:13.172112+0000","last_fullsized":"2024-09-16T16:57:13.172112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.020711+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:13.020711+0000","last_peered":"2024-09-16T16:57:13.020711+0000","last_clean":"2024-09-16T16:57:13.020711+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:13.020711+0000","last_undegraded":"2024-09-16T16:57:13.020711+0000","last_fullsized":"2024-09-16T16:57:13.020711+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.052866+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:13.052866+0000","last_peered":"2024-09-16T16:57:13.052866+0000","last_clean":"2024-09-16T16:57:13.052866+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:13.052866+0000","last_undegraded":"2024-09-16T16:57:13.052866+0000","last_fullsized":"2024-09-16T16:57:13.052866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"64'331","reported_seq":361,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.230771+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:13.230771+0000","last_peered":"2024-09-16T16:57:13.230771+0000","last_clean":"2024-09-16T16:57:13.230771+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:13.230771+0000","last_undegraded":"2024-09-16T16:57:13.230771+0000","last_fullsized":"2024-09-16T16:57:13.230771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.164621+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:13.164621+0000","last_peered":"2024-09-16T16:57:13.164621+0000","last_clean":"2024-09-16T16:57:13.164621+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:13.164621+0000","last_undegraded":"2024-09-16T16:57:13.164621+0000","last_fullsized":"2024-09-16T16:57:13.164621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"64'365","reported_seq":395,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756996+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:13.756996+0000","last_peered":"2024-09-16T16:57:13.756996+0000","last_clean":"2024-09-16T16:57:13.756996+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:13.756996+0000","last_undegraded":"2024-09-16T16:57:13.756996+0000","last_fullsized":"2024-09-16T16:57:13.756996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.049461+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:13.049461+0000","last_peered":"2024-09-16T16:57:13.049461+0000","last_clean":"2024-09-16T16:57:13.049461+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:13.049461+0000","last_undegraded":"2024-09-16T16:57:13.049461+0000","last_fullsized":"2024-09-16T16:57:13.049461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"64'329","reported_seq":359,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.309016+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:13.309016+0000","last_peered":"2024-09-16T16:57:13.309016+0000","last_clean":"2024-09-16T16:57:13.309016+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:13.309016+0000","last_undegraded":"2024-09-16T16:57:13.309016+0000","last_fullsized":"2024-09-16T16:57:13.309016+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.166570+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:13.166570+0000","last_peered":"2024-09-16T16:57:13.166570+0000","last_clean":"2024-09-16T16:57:13.166570+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:13.166570+0000","last_undegraded":"2024-09-16T16:57:13.166570+0000","last_fullsized":"2024-09-16T16:57:13.166570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"64'341","reported_seq":371,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.799068+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:13.799068+0000","last_peered":"2024-09-16T16:57:13.799068+0000","last_clean":"2024-09-16T16:57:13.799068+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:13.799068+0000","last_undegraded":"2024-09-16T16:57:13.799068+0000","last_fullsized":"2024-09-16T16:57:13.799068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.111615+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:13.111615+0000","last_peered":"2024-09-16T16:57:13.111615+0000","last_clean":"2024-09-16T16:57:13.111615+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:13.111615+0000","last_undegraded":"2024-09-16T16:57:13.111615+0000","last_fullsized":"2024-09-16T16:57:13.111615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.782832+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:13.782832+0000","last_peered":"2024-09-16T16:57:13.782832+0000","last_clean":"2024-09-16T16:57:13.782832+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:13.782832+0000","last_undegraded":"2024-09-16T16:57:13.782832+0000","last_fullsized":"2024-09-16T16:57:13.782832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.038331+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:13.038331+0000","last_peered":"2024-09-16T16:57:13.038331+0000","last_clean":"2024-09-16T16:57:13.038331+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:13.038331+0000","last_undegraded":"2024-09-16T16:57:13.038331+0000","last_fullsized":"2024-09-16T16:57:13.038331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"64'320","reported_seq":350,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.063359+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:13.063359+0000","last_peered":"2024-09-16T16:57:13.063359+0000","last_clean":"2024-09-16T16:57:13.063359+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:13.063359+0000","last_undegraded":"2024-09-16T16:57:13.063359+0000","last_fullsized":"2024-09-16T16:57:13.063359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.110891+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:13.110891+0000","last_peered":"2024-09-16T16:57:13.110891+0000","last_clean":"2024-09-16T16:57:13.110891+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:13.110891+0000","last_undegraded":"2024-09-16T16:57:13.110891+0000","last_fullsized":"2024-09-16T16:57:13.110891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"64'312","reported_seq":342,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.462601+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:13.462601+0000","last_peered":"2024-09-16T16:57:13.462601+0000","last_clean":"2024-09-16T16:57:13.462601+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:13.462601+0000","last_undegraded":"2024-09-16T16:57:13.462601+0000","last_fullsized":"2024-09-16T16:57:13.462601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.053609+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:13.053609+0000","last_peered":"2024-09-16T16:57:13.053609+0000","last_clean":"2024-09-16T16:57:13.053609+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:13.053609+0000","last_undegraded":"2024-09-16T16:57:13.053609+0000","last_fullsized":"2024-09-16T16:57:13.053609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":347136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5424,"ondisk_log_size":5424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":479524,"kb_used_data":479524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51818204,"statfs":{"total":53552873472,"available":53061840896,"internally_reserved":0,"allocated":491032576,"data_stored":491032576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489032,"kb_used_data":489032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808696,"statfs":{"total":53552873472,"available":53052104704,"internally_reserved":0,"allocated":500768768,"data_stored":500768768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562772,"kb_used_data":562772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734956,"statfs":{"total":53552873472,"available":52976594944,"internally_reserved":0,"allocated":576278528,"data_stored":576278528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555800,"kb_used_data":555800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741928,"statfs":{"total":53552873472,"available":52983734272,"internally_reserved":0,"allocated":569139200,"data_stored":569139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:27.732 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:57:27.732 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:27.732 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:27.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:27.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 6861 6845 6.78998 6 0.179716 0.147075 2024-09-16T16:57:27.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:27.877+0000 7f985de9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:27.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:27.897+0000 7f985de9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.035 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:28.035 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:28.036 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:28.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:28.041 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:28.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.210+0000 7f4ec22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.223+0000 7f4ec22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:28.334 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:28.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:28.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:28.335 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:28.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:28.339 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:28.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:28.358 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:28.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.513+0000 7f13ba591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.531+0000 7f13ba591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.564+0000 7fb773aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.575+0000 7fb773aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:28.704 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:28.705 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:28.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:28.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:28.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:28.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 6950 6934 6.77079 5.5625 0.171232 0.14743 2024-09-16T16:57:28.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.877+0000 7f5cd6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:28.891+0000 7f5cd6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:28.923 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:28.923 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:28.923 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:28.923 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:28.924 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:28.928 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:28.929 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:29.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 7055 7039 6.76757 6.5625 0.0728211 0.147539 2024-09-16T16:57:30.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 7160 7144 6.76446 6.5625 0.0451487 0.147603 2024-09-16T16:57:31.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:31.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:31.298+0000 7f6719951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:31.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:31.305+0000 7f6719951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:31.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 7265 7249 6.76144 6.5625 0.080772 0.147715 2024-09-16T16:57:32.872 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 7374 7358 6.76217 6.8125 0.084592 0.147703 2024-09-16T16:57:33.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 7489 7473 6.76832 7.1875 0.0905145 0.147535 2024-09-16T16:57:33.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:33.930 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:33.930 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:33.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:34.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:34.024+0000 7f2800ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:34.031+0000 7f2800ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:34.100+0000 7fd7b5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:34.115+0000 7fd7b5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.422 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:57:34.423 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:57:34.443 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-09-16T16:57:33.893095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":356057651,"num_objects":5428,"num_object_clones":0,"num_object_copies":16284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5505,"num_write_kb":348244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5479,"ondisk_log_size":5479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2087128,"kb_used_data":2087128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207103784,"statfs":{"total":214211493888,"available":212074274816,"internally_reserved":0,"allocated":2137219072,"data_stored":2137219072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.137898"},"pg_stats":[{"pgid":"6.f","version":"64'364","reported_seq":394,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.657540+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:13.657540+0000","last_peered":"2024-09-16T16:57:13.657540+0000","last_clean":"2024-09-16T16:57:13.657540+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:13.657540+0000","last_undegraded":"2024-09-16T16:57:13.657540+0000","last_fullsized":"2024-09-16T16:57:13.657540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"64'338","reported_seq":368,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.641023+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:13.641023+0000","last_peered":"2024-09-16T16:57:13.641023+0000","last_clean":"2024-09-16T16:57:13.641023+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:13.641023+0000","last_undegraded":"2024-09-16T16:57:13.641023+0000","last_fullsized":"2024-09-16T16:57:13.641023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22151168,"num_objects":338,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":338,"num_write_kb":21632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"64'343","reported_seq":373,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.447264+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:13.447264+0000","last_peered":"2024-09-16T16:57:13.447264+0000","last_clean":"2024-09-16T16:57:13.447264+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:13.447264+0000","last_undegraded":"2024-09-16T16:57:13.447264+0000","last_fullsized":"2024-09-16T16:57:13.447264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":21952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"64'360","reported_seq":390,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756448+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:13.756448+0000","last_peered":"2024-09-16T16:57:13.756448+0000","last_clean":"2024-09-16T16:57:13.756448+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:13.756448+0000","last_undegraded":"2024-09-16T16:57:13.756448+0000","last_fullsized":"2024-09-16T16:57:13.756448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"64'345","reported_seq":375,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.546886+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:13.546886+0000","last_peered":"2024-09-16T16:57:13.546886+0000","last_clean":"2024-09-16T16:57:13.546886+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:13.546886+0000","last_undegraded":"2024-09-16T16:57:13.546886+0000","last_fullsized":"2024-09-16T16:57:13.546886+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"64'346","reported_seq":376,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.786469+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:13.786469+0000","last_peered":"2024-09-16T16:57:13.786469+0000","last_clean":"2024-09-16T16:57:13.786469+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:13.786469+0000","last_undegraded":"2024-09-16T16:57:13.786469+0000","last_fullsized":"2024-09-16T16:57:13.786469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"64'336","reported_seq":366,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.530684+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:13.530684+0000","last_peered":"2024-09-16T16:57:13.530684+0000","last_clean":"2024-09-16T16:57:13.530684+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:13.530684+0000","last_undegraded":"2024-09-16T16:57:13.530684+0000","last_fullsized":"2024-09-16T16:57:13.530684+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"64'330","reported_seq":360,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.677939+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:13.677939+0000","last_peered":"2024-09-16T16:57:13.677939+0000","last_clean":"2024-09-16T16:57:13.677939+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:13.677939+0000","last_undegraded":"2024-09-16T16:57:13.677939+0000","last_fullsized":"2024-09-16T16:57:13.677939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.172112+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:13.172112+0000","last_peered":"2024-09-16T16:57:13.172112+0000","last_clean":"2024-09-16T16:57:13.172112+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:13.172112+0000","last_undegraded":"2024-09-16T16:57:13.172112+0000","last_fullsized":"2024-09-16T16:57:13.172112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.020711+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:13.020711+0000","last_peered":"2024-09-16T16:57:13.020711+0000","last_clean":"2024-09-16T16:57:13.020711+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:13.020711+0000","last_undegraded":"2024-09-16T16:57:13.020711+0000","last_fullsized":"2024-09-16T16:57:13.020711+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.052866+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:13.052866+0000","last_peered":"2024-09-16T16:57:13.052866+0000","last_clean":"2024-09-16T16:57:13.052866+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:13.052866+0000","last_undegraded":"2024-09-16T16:57:13.052866+0000","last_fullsized":"2024-09-16T16:57:13.052866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"64'331","reported_seq":361,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.230771+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:13.230771+0000","last_peered":"2024-09-16T16:57:13.230771+0000","last_clean":"2024-09-16T16:57:13.230771+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:13.230771+0000","last_undegraded":"2024-09-16T16:57:13.230771+0000","last_fullsized":"2024-09-16T16:57:13.230771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.164621+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:13.164621+0000","last_peered":"2024-09-16T16:57:13.164621+0000","last_clean":"2024-09-16T16:57:13.164621+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:13.164621+0000","last_undegraded":"2024-09-16T16:57:13.164621+0000","last_fullsized":"2024-09-16T16:57:13.164621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"64'365","reported_seq":395,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.756996+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:13.756996+0000","last_peered":"2024-09-16T16:57:13.756996+0000","last_clean":"2024-09-16T16:57:13.756996+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:13.756996+0000","last_undegraded":"2024-09-16T16:57:13.756996+0000","last_fullsized":"2024-09-16T16:57:13.756996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.049461+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:13.049461+0000","last_peered":"2024-09-16T16:57:13.049461+0000","last_clean":"2024-09-16T16:57:13.049461+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:13.049461+0000","last_undegraded":"2024-09-16T16:57:13.049461+0000","last_fullsized":"2024-09-16T16:57:13.049461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"64'329","reported_seq":359,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.309016+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:13.309016+0000","last_peered":"2024-09-16T16:57:13.309016+0000","last_clean":"2024-09-16T16:57:13.309016+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:13.309016+0000","last_undegraded":"2024-09-16T16:57:13.309016+0000","last_fullsized":"2024-09-16T16:57:13.309016+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.166570+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:13.166570+0000","last_peered":"2024-09-16T16:57:13.166570+0000","last_clean":"2024-09-16T16:57:13.166570+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:13.166570+0000","last_undegraded":"2024-09-16T16:57:13.166570+0000","last_fullsized":"2024-09-16T16:57:13.166570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"64'341","reported_seq":371,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.799068+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:13.799068+0000","last_peered":"2024-09-16T16:57:13.799068+0000","last_clean":"2024-09-16T16:57:13.799068+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:13.799068+0000","last_undegraded":"2024-09-16T16:57:13.799068+0000","last_fullsized":"2024-09-16T16:57:13.799068+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.111615+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:13.111615+0000","last_peered":"2024-09-16T16:57:13.111615+0000","last_clean":"2024-09-16T16:57:13.111615+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:13.111615+0000","last_undegraded":"2024-09-16T16:57:13.111615+0000","last_fullsized":"2024-09-16T16:57:13.111615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"64'332","reported_seq":362,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.782832+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:13.782832+0000","last_peered":"2024-09-16T16:57:13.782832+0000","last_clean":"2024-09-16T16:57:13.782832+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:13.782832+0000","last_undegraded":"2024-09-16T16:57:13.782832+0000","last_fullsized":"2024-09-16T16:57:13.782832+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21757952,"num_objects":332,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":21248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.038331+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:13.038331+0000","last_peered":"2024-09-16T16:57:13.038331+0000","last_clean":"2024-09-16T16:57:13.038331+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:13.038331+0000","last_undegraded":"2024-09-16T16:57:13.038331+0000","last_fullsized":"2024-09-16T16:57:13.038331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"64'320","reported_seq":350,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.063359+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:13.063359+0000","last_peered":"2024-09-16T16:57:13.063359+0000","last_clean":"2024-09-16T16:57:13.063359+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:13.063359+0000","last_undegraded":"2024-09-16T16:57:13.063359+0000","last_fullsized":"2024-09-16T16:57:13.063359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.110891+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:13.110891+0000","last_peered":"2024-09-16T16:57:13.110891+0000","last_clean":"2024-09-16T16:57:13.110891+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:13.110891+0000","last_undegraded":"2024-09-16T16:57:13.110891+0000","last_fullsized":"2024-09-16T16:57:13.110891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"64'312","reported_seq":342,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.462601+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:13.462601+0000","last_peered":"2024-09-16T16:57:13.462601+0000","last_clean":"2024-09-16T16:57:13.462601+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:13.462601+0000","last_undegraded":"2024-09-16T16:57:13.462601+0000","last_fullsized":"2024-09-16T16:57:13.462601+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-16T16:57:13.053609+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:13.053609+0000","last_peered":"2024-09-16T16:57:13.053609+0000","last_clean":"2024-09-16T16:57:13.053609+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:13.053609+0000","last_undegraded":"2024-09-16T16:57:13.053609+0000","last_fullsized":"2024-09-16T16:57:13.053609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":355467264,"num_objects":5424,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5424,"num_write_kb":347136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5424,"ondisk_log_size":5424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212053135360,"internally_reserved":0,"allocated":2158358528,"data_stored":2158358528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":479524,"kb_used_data":479524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51818204,"statfs":{"total":53552873472,"available":53061840896,"internally_reserved":0,"allocated":491032576,"data_stored":491032576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":489032,"kb_used_data":489032,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51808696,"statfs":{"total":53552873472,"available":53052104704,"internally_reserved":0,"allocated":500768768,"data_stored":500768768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":562772,"kb_used_data":562772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51734956,"statfs":{"total":53552873472,"available":52976594944,"internally_reserved":0,"allocated":576278528,"data_stored":576278528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":555800,"kb_used_data":555800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51741928,"statfs":{"total":53552873472,"available":52983734272,"internally_reserved":0,"allocated":569139200,"data_stored":569139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52972900352,"internally_reserved":0,"allocated":579973120,"data_stored":579973120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52972126208,"internally_reserved":0,"allocated":580747264,"data_stored":580747264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53049876480,"internally_reserved":0,"allocated":502996992,"data_stored":502996992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53058232320,"internally_reserved":0,"allocated":494641152,"data_stored":494641152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:34.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 7595 7579 6.76626 6.625 0.136863 0.147633 2024-09-16T16:57:35.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 7684 7668 6.7493 5.5625 0.375775 0.147895 2024-09-16T16:57:36.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:36.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:36.696+0000 7fc8c4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:36.705+0000 7fc8c4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:36.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 7785 7769 6.74323 6.3125 0.310782 0.1481 2024-09-16T16:57:37.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 7896 7880 6.74588 6.9375 0.0806704 0.14803 2024-09-16T16:57:38.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 8003 7987 6.74508 6.6875 0.566022 0.148051 2024-09-16T16:57:39.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:39.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.265+0000 7f6954efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.274+0000 7f6954efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.445 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:39.446 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:39.446 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:39.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.603+0000 7f126cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.621+0000 7f126cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.761 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:39.761 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:39.761 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:39.761 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:39.762 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:39.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:39.765 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:39.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:39.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 8105 8089 6.74014 6.375 0.0561825 0.14816 2024-09-16T16:57:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.976+0000 7f80cd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:39.989+0000 7f80cd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.109 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:40.110 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:40.114 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:40.114 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:40.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:40.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:40.290+0000 7f2d1b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:40.305+0000 7f2d1b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.330 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:40.330 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:40.330 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:40.330 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:40.335 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:40.335 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:40.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:40.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:40.484+0000 7f9c1b24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:40.496+0000 7f9c1b24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.521 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:40.521 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:40.521 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:40.522 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:40.525 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:40.525 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:40.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 8223 8207 6.74848 7.375 0.149082 0.148064 2024-09-16T16:57:41.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:41.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 8326 8310 6.74443 6.4375 0.0997091 0.148115 2024-09-16T16:57:42.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:42.016+0000 7fba1aebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:42.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:42.026+0000 7fba1aebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:42.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 8434 8418 6.74449 6.75 0.0955926 0.148024 2024-09-16T16:57:43.873 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 8551 8535 6.75167 7.3125 0.135877 0.14795 2024-09-16T16:57:44.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:44.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:44.575+0000 7f186aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:44.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:44.586+0000 7f186aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:44.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:57:44.874002+0000 min lat: 0.0228392 max lat: 0.666096 avg lat: 0.147922 2024-09-16T16:57:44.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:44.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 8659 8643 6.75165 6.75 0.0872612 0.147922 2024-09-16T16:57:45.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:45.526 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:45.527 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:45.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:45.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:45.688+0000 7f9b72591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:45.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:45.700+0000 7f9b72591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:45.798 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:45.799 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:45.799 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:45.802 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:45.802 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:45.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:45.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 8769 8753 6.75314 6.875 0.149047 0.147868 2024-09-16T16:57:45.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:45.950+0000 7f3d41791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:45.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:45.961+0000 7f3d41791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:46.084 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:46.085 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:46.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:46.089 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:46.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:46.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:46.268+0000 7fdc4f688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:46.285+0000 7fdc4f688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.455 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:46.456 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:46.459 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:46.460 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:46.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:46.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:46.637+0000 7f409e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:46.655+0000 7f409e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:46.698 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:46.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:46.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:46.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:46.699 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:46.699 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:46.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:46.703 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:46.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 8885 8869 6.75919 7.25 0.128604 0.147822 2024-09-16T16:57:47.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:47.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:47.199+0000 7f20ae711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:47.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:47.206+0000 7f20ae711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:47.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 8993 8977 6.75907 6.75 0.136206 0.147777 2024-09-16T16:57:48.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 9099 9083 6.75747 6.625 0.205168 0.147832 2024-09-16T16:57:49.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:49.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:49.772+0000 7ff98f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:49.779+0000 7ff98f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:49.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 9189 9173 6.74414 5.625 0.227353 0.14804 2024-09-16T16:57:50.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 9296 9280 6.74347 6.6875 0.0691596 0.148145 2024-09-16T16:57:51.704 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:51.704 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:51.704 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:51.705 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:51.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 9394 9378 6.73636 6.125 0.219706 0.148276 2024-09-16T16:57:51.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:51.878+0000 7f7465888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:51.896+0000 7f7465888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:52.055 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:52.055 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:52.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:52.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:52.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.234+0000 7f8329b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.254+0000 7f8329b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.265+0000 7fd2676a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.275+0000 7fd2676a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:52.435 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:52.436 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:52.440 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:52.440 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:52.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.623+0000 7f6b700fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.641+0000 7f6b700fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:52.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:52.761 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:52.761 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:52.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 9501 9485 6.73579 6.6875 0.107109 0.148323 2024-09-16T16:57:52.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.974+0000 7f5df9eb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:52.991+0000 7f5df9eb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:57:53.038 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:57:53.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:53.041 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:53.874 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 9615 9599 6.74016 7.125 0.0504106 0.148229 2024-09-16T16:57:54.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:54.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:54.772+0000 7f7306474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:54.783+0000 7f7306474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 15 9728 9713 6.74443 7.125 0.138318 0.148096 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1009 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 9728 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 6.74799 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.566367 2024-09-16T16:57:55.875 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 8 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 5.3125 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 107 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 9.06187 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 128 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 85 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.148093 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.0831514 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 0.666096 2024-09-16T16:57:55.876 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0228392 2024-09-16T16:57:55.910 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:57:57.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:57.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:57.185+0000 7f4880cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:57.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:57.194+0000 7f4880cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:58.042 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:58.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:57:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:58.191+0000 7f779eea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:58.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:58.208+0000 7f779eea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:58.761 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:57:58.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:57:58.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:58.942+0000 7f72e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:58.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:58.962+0000 7f72e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:59.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:57:59.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:57:59.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:59.835+0000 7f9a9aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:59.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:59.842+0000 7f9a9aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:59.960+0000 7f72916bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:59.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:57:59.974+0000 7f72916bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:00.775 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:58:00.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:58:00.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:00.940+0000 7f8bfbefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:00.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:00.953+0000 7f8bfbefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:58:01.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:58:01.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:01.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:01.877+0000 7f6f2c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:01.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:01.889+0000 7f6f2c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.218 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:02.219 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:02.233 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-16T16:58:01.898638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3296696,"kb_used_data":3296696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205894216,"statfs":{"total":214211493888,"available":210835677184,"internally_reserved":0,"allocated":3375816704,"data_stored":3375816704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000748"},"pg_stats":[{"pgid":"6.f","version":"72'567","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.400634+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:43.400634+0000","last_peered":"2024-09-16T16:57:43.400634+0000","last_clean":"2024-09-16T16:57:43.400634+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:43.400634+0000","last_undegraded":"2024-09-16T16:57:43.400634+0000","last_fullsized":"2024-09-16T16:57:43.400634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'517","reported_seq":571,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.634764+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:43.634764+0000","last_peered":"2024-09-16T16:57:43.634764+0000","last_clean":"2024-09-16T16:57:43.634764+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:43.634764+0000","last_undegraded":"2024-09-16T16:57:43.634764+0000","last_fullsized":"2024-09-16T16:57:43.634764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'539","reported_seq":593,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.614162+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:43.614162+0000","last_peered":"2024-09-16T16:57:43.614162+0000","last_clean":"2024-09-16T16:57:43.614162+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:43.614162+0000","last_undegraded":"2024-09-16T16:57:43.614162+0000","last_fullsized":"2024-09-16T16:57:43.614162+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35323904,"num_objects":539,"num_object_clones":0,"num_object_copies":1617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'569","reported_seq":623,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.567501+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:43.567501+0000","last_peered":"2024-09-16T16:57:43.567501+0000","last_clean":"2024-09-16T16:57:43.567501+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:43.567501+0000","last_undegraded":"2024-09-16T16:57:43.567501+0000","last_fullsized":"2024-09-16T16:57:43.567501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":36416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'553","reported_seq":607,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.651605+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:43.651605+0000","last_peered":"2024-09-16T16:57:43.651605+0000","last_clean":"2024-09-16T16:57:43.651605+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:43.651605+0000","last_undegraded":"2024-09-16T16:57:43.651605+0000","last_fullsized":"2024-09-16T16:57:43.651605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'533","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.808221+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:43.808221+0000","last_peered":"2024-09-16T16:57:43.808221+0000","last_clean":"2024-09-16T16:57:43.808221+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:43.808221+0000","last_undegraded":"2024-09-16T16:57:43.808221+0000","last_fullsized":"2024-09-16T16:57:43.808221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'538","reported_seq":592,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.517582+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:43.517582+0000","last_peered":"2024-09-16T16:57:43.517582+0000","last_clean":"2024-09-16T16:57:43.517582+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:43.517582+0000","last_undegraded":"2024-09-16T16:57:43.517582+0000","last_fullsized":"2024-09-16T16:57:43.517582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'557","reported_seq":611,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.662431+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:43.662431+0000","last_peered":"2024-09-16T16:57:43.662431+0000","last_clean":"2024-09-16T16:57:43.662431+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:43.662431+0000","last_undegraded":"2024-09-16T16:57:43.662431+0000","last_fullsized":"2024-09-16T16:57:43.662431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.584473+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:43.584473+0000","last_peered":"2024-09-16T16:57:43.584473+0000","last_clean":"2024-09-16T16:57:43.584473+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:43.584473+0000","last_undegraded":"2024-09-16T16:57:43.584473+0000","last_fullsized":"2024-09-16T16:57:43.584473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.845263+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:26.845263+0000","last_peered":"2024-09-16T16:57:26.845263+0000","last_clean":"2024-09-16T16:57:26.845263+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:26.845263+0000","last_undegraded":"2024-09-16T16:57:26.845263+0000","last_fullsized":"2024-09-16T16:57:26.845263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.823663+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:26.823663+0000","last_peered":"2024-09-16T16:57:26.823663+0000","last_clean":"2024-09-16T16:57:26.823663+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:26.823663+0000","last_undegraded":"2024-09-16T16:57:26.823663+0000","last_fullsized":"2024-09-16T16:57:26.823663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'530","reported_seq":584,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.581998+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:43.581998+0000","last_peered":"2024-09-16T16:57:43.581998+0000","last_clean":"2024-09-16T16:57:43.581998+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:43.581998+0000","last_undegraded":"2024-09-16T16:57:43.581998+0000","last_fullsized":"2024-09-16T16:57:43.581998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":33920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.922359+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:26.922359+0000","last_peered":"2024-09-16T16:57:26.922359+0000","last_clean":"2024-09-16T16:57:26.922359+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:26.922359+0000","last_undegraded":"2024-09-16T16:57:26.922359+0000","last_fullsized":"2024-09-16T16:57:26.922359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'560","reported_seq":614,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.576613+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:43.576613+0000","last_peered":"2024-09-16T16:57:43.576613+0000","last_clean":"2024-09-16T16:57:43.576613+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:43.576613+0000","last_undegraded":"2024-09-16T16:57:43.576613+0000","last_fullsized":"2024-09-16T16:57:43.576613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.814644+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:26.814644+0000","last_peered":"2024-09-16T16:57:26.814644+0000","last_clean":"2024-09-16T16:57:26.814644+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:26.814644+0000","last_undegraded":"2024-09-16T16:57:26.814644+0000","last_fullsized":"2024-09-16T16:57:26.814644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'536","reported_seq":590,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.724571+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:43.724571+0000","last_peered":"2024-09-16T16:57:43.724571+0000","last_clean":"2024-09-16T16:57:43.724571+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:43.724571+0000","last_undegraded":"2024-09-16T16:57:43.724571+0000","last_fullsized":"2024-09-16T16:57:43.724571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.918423+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:26.918423+0000","last_peered":"2024-09-16T16:57:26.918423+0000","last_clean":"2024-09-16T16:57:26.918423+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:26.918423+0000","last_undegraded":"2024-09-16T16:57:26.918423+0000","last_fullsized":"2024-09-16T16:57:26.918423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.640952+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:43.640952+0000","last_peered":"2024-09-16T16:57:43.640952+0000","last_clean":"2024-09-16T16:57:43.640952+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:43.640952+0000","last_undegraded":"2024-09-16T16:57:43.640952+0000","last_fullsized":"2024-09-16T16:57:43.640952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.831448+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:26.831448+0000","last_peered":"2024-09-16T16:57:26.831448+0000","last_clean":"2024-09-16T16:57:26.831448+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:26.831448+0000","last_undegraded":"2024-09-16T16:57:26.831448+0000","last_fullsized":"2024-09-16T16:57:26.831448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.800549+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:43.800549+0000","last_peered":"2024-09-16T16:57:43.800549+0000","last_clean":"2024-09-16T16:57:43.800549+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:43.800549+0000","last_undegraded":"2024-09-16T16:57:43.800549+0000","last_fullsized":"2024-09-16T16:57:43.800549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.851274+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:26.851274+0000","last_peered":"2024-09-16T16:57:26.851274+0000","last_clean":"2024-09-16T16:57:26.851274+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:26.851274+0000","last_undegraded":"2024-09-16T16:57:26.851274+0000","last_fullsized":"2024-09-16T16:57:26.851274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'515","reported_seq":569,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.322153+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:43.322153+0000","last_peered":"2024-09-16T16:57:43.322153+0000","last_clean":"2024-09-16T16:57:43.322153+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:43.322153+0000","last_undegraded":"2024-09-16T16:57:43.322153+0000","last_fullsized":"2024-09-16T16:57:43.322153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.824101+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:26.824101+0000","last_peered":"2024-09-16T16:57:26.824101+0000","last_clean":"2024-09-16T16:57:26.824101+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:26.824101+0000","last_undegraded":"2024-09-16T16:57:26.824101+0000","last_fullsized":"2024-09-16T16:57:26.824101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'478","reported_seq":532,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.207691+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:43.207691+0000","last_peered":"2024-09-16T16:57:43.207691+0000","last_clean":"2024-09-16T16:57:43.207691+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:43.207691+0000","last_undegraded":"2024-09-16T16:57:43.207691+0000","last_fullsized":"2024-09-16T16:57:43.207691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.818927+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:26.818927+0000","last_peered":"2024-09-16T16:57:26.818927+0000","last_clean":"2024-09-16T16:57:26.818927+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:26.818927+0000","last_undegraded":"2024-09-16T16:57:26.818927+0000","last_fullsized":"2024-09-16T16:57:26.818927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815275008,"internally_reserved":0,"allocated":3396218880,"data_stored":3396218880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815406080,"internally_reserved":0,"allocated":3396087808,"data_stored":3396087808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":759472,"kb_used_data":759472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51538256,"statfs":{"total":53552873472,"available":52775174144,"internally_reserved":0,"allocated":777699328,"data_stored":777699328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":769416,"kb_used_data":769416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51528312,"statfs":{"total":53552873472,"available":52764991488,"internally_reserved":0,"allocated":787881984,"data_stored":787881984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":888600,"kb_used_data":888600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51409128,"statfs":{"total":53552873472,"available":52642947072,"internally_reserved":0,"allocated":909926400,"data_stored":909926400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":879208,"kb_used_data":879208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51418520,"statfs":{"total":53552873472,"available":52652564480,"internally_reserved":0,"allocated":900308992,"data_stored":900308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52763807744,"internally_reserved":0,"allocated":789065728,"data_stored":789065728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52763676672,"internally_reserved":0,"allocated":789196800,"data_stored":789196800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:02.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:02.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:02.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.393+0000 7f6e87aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.408+0000 7f6e87aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.460+0000 7f5f97751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.468+0000 7f5f97751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.736 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:02.760 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-16T16:58:01.898638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3296696,"kb_used_data":3296696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205894216,"statfs":{"total":214211493888,"available":210835677184,"internally_reserved":0,"allocated":3375816704,"data_stored":3375816704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000748"},"pg_stats":[{"pgid":"6.f","version":"72'567","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.400634+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:43.400634+0000","last_peered":"2024-09-16T16:57:43.400634+0000","last_clean":"2024-09-16T16:57:43.400634+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:43.400634+0000","last_undegraded":"2024-09-16T16:57:43.400634+0000","last_fullsized":"2024-09-16T16:57:43.400634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'517","reported_seq":571,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.634764+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:43.634764+0000","last_peered":"2024-09-16T16:57:43.634764+0000","last_clean":"2024-09-16T16:57:43.634764+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:43.634764+0000","last_undegraded":"2024-09-16T16:57:43.634764+0000","last_fullsized":"2024-09-16T16:57:43.634764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'539","reported_seq":593,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.614162+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:43.614162+0000","last_peered":"2024-09-16T16:57:43.614162+0000","last_clean":"2024-09-16T16:57:43.614162+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:43.614162+0000","last_undegraded":"2024-09-16T16:57:43.614162+0000","last_fullsized":"2024-09-16T16:57:43.614162+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35323904,"num_objects":539,"num_object_clones":0,"num_object_copies":1617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'569","reported_seq":623,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.567501+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:43.567501+0000","last_peered":"2024-09-16T16:57:43.567501+0000","last_clean":"2024-09-16T16:57:43.567501+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:43.567501+0000","last_undegraded":"2024-09-16T16:57:43.567501+0000","last_fullsized":"2024-09-16T16:57:43.567501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":36416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'553","reported_seq":607,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.651605+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:43.651605+0000","last_peered":"2024-09-16T16:57:43.651605+0000","last_clean":"2024-09-16T16:57:43.651605+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:43.651605+0000","last_undegraded":"2024-09-16T16:57:43.651605+0000","last_fullsized":"2024-09-16T16:57:43.651605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'533","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.808221+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:43.808221+0000","last_peered":"2024-09-16T16:57:43.808221+0000","last_clean":"2024-09-16T16:57:43.808221+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:43.808221+0000","last_undegraded":"2024-09-16T16:57:43.808221+0000","last_fullsized":"2024-09-16T16:57:43.808221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'538","reported_seq":592,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.517582+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:43.517582+0000","last_peered":"2024-09-16T16:57:43.517582+0000","last_clean":"2024-09-16T16:57:43.517582+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:43.517582+0000","last_undegraded":"2024-09-16T16:57:43.517582+0000","last_fullsized":"2024-09-16T16:57:43.517582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'557","reported_seq":611,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.662431+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:43.662431+0000","last_peered":"2024-09-16T16:57:43.662431+0000","last_clean":"2024-09-16T16:57:43.662431+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:43.662431+0000","last_undegraded":"2024-09-16T16:57:43.662431+0000","last_fullsized":"2024-09-16T16:57:43.662431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.584473+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:43.584473+0000","last_peered":"2024-09-16T16:57:43.584473+0000","last_clean":"2024-09-16T16:57:43.584473+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:43.584473+0000","last_undegraded":"2024-09-16T16:57:43.584473+0000","last_fullsized":"2024-09-16T16:57:43.584473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.845263+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:26.845263+0000","last_peered":"2024-09-16T16:57:26.845263+0000","last_clean":"2024-09-16T16:57:26.845263+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:26.845263+0000","last_undegraded":"2024-09-16T16:57:26.845263+0000","last_fullsized":"2024-09-16T16:57:26.845263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.823663+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:26.823663+0000","last_peered":"2024-09-16T16:57:26.823663+0000","last_clean":"2024-09-16T16:57:26.823663+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:26.823663+0000","last_undegraded":"2024-09-16T16:57:26.823663+0000","last_fullsized":"2024-09-16T16:57:26.823663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'530","reported_seq":584,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.581998+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:43.581998+0000","last_peered":"2024-09-16T16:57:43.581998+0000","last_clean":"2024-09-16T16:57:43.581998+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:43.581998+0000","last_undegraded":"2024-09-16T16:57:43.581998+0000","last_fullsized":"2024-09-16T16:57:43.581998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":33920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.922359+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:26.922359+0000","last_peered":"2024-09-16T16:57:26.922359+0000","last_clean":"2024-09-16T16:57:26.922359+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:26.922359+0000","last_undegraded":"2024-09-16T16:57:26.922359+0000","last_fullsized":"2024-09-16T16:57:26.922359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'560","reported_seq":614,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.576613+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:43.576613+0000","last_peered":"2024-09-16T16:57:43.576613+0000","last_clean":"2024-09-16T16:57:43.576613+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:43.576613+0000","last_undegraded":"2024-09-16T16:57:43.576613+0000","last_fullsized":"2024-09-16T16:57:43.576613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.814644+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:26.814644+0000","last_peered":"2024-09-16T16:57:26.814644+0000","last_clean":"2024-09-16T16:57:26.814644+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:26.814644+0000","last_undegraded":"2024-09-16T16:57:26.814644+0000","last_fullsized":"2024-09-16T16:57:26.814644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'536","reported_seq":590,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.724571+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:43.724571+0000","last_peered":"2024-09-16T16:57:43.724571+0000","last_clean":"2024-09-16T16:57:43.724571+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:43.724571+0000","last_undegraded":"2024-09-16T16:57:43.724571+0000","last_fullsized":"2024-09-16T16:57:43.724571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.918423+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:26.918423+0000","last_peered":"2024-09-16T16:57:26.918423+0000","last_clean":"2024-09-16T16:57:26.918423+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:26.918423+0000","last_undegraded":"2024-09-16T16:57:26.918423+0000","last_fullsized":"2024-09-16T16:57:26.918423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.640952+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:43.640952+0000","last_peered":"2024-09-16T16:57:43.640952+0000","last_clean":"2024-09-16T16:57:43.640952+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:43.640952+0000","last_undegraded":"2024-09-16T16:57:43.640952+0000","last_fullsized":"2024-09-16T16:57:43.640952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.831448+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:26.831448+0000","last_peered":"2024-09-16T16:57:26.831448+0000","last_clean":"2024-09-16T16:57:26.831448+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:26.831448+0000","last_undegraded":"2024-09-16T16:57:26.831448+0000","last_fullsized":"2024-09-16T16:57:26.831448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.800549+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:43.800549+0000","last_peered":"2024-09-16T16:57:43.800549+0000","last_clean":"2024-09-16T16:57:43.800549+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:43.800549+0000","last_undegraded":"2024-09-16T16:57:43.800549+0000","last_fullsized":"2024-09-16T16:57:43.800549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.851274+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:26.851274+0000","last_peered":"2024-09-16T16:57:26.851274+0000","last_clean":"2024-09-16T16:57:26.851274+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:26.851274+0000","last_undegraded":"2024-09-16T16:57:26.851274+0000","last_fullsized":"2024-09-16T16:57:26.851274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'515","reported_seq":569,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.322153+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:43.322153+0000","last_peered":"2024-09-16T16:57:43.322153+0000","last_clean":"2024-09-16T16:57:43.322153+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:43.322153+0000","last_undegraded":"2024-09-16T16:57:43.322153+0000","last_fullsized":"2024-09-16T16:57:43.322153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.824101+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:26.824101+0000","last_peered":"2024-09-16T16:57:26.824101+0000","last_clean":"2024-09-16T16:57:26.824101+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:26.824101+0000","last_undegraded":"2024-09-16T16:57:26.824101+0000","last_fullsized":"2024-09-16T16:57:26.824101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'478","reported_seq":532,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.207691+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:43.207691+0000","last_peered":"2024-09-16T16:57:43.207691+0000","last_clean":"2024-09-16T16:57:43.207691+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:43.207691+0000","last_undegraded":"2024-09-16T16:57:43.207691+0000","last_fullsized":"2024-09-16T16:57:43.207691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.818927+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:26.818927+0000","last_peered":"2024-09-16T16:57:26.818927+0000","last_clean":"2024-09-16T16:57:26.818927+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:26.818927+0000","last_undegraded":"2024-09-16T16:57:26.818927+0000","last_fullsized":"2024-09-16T16:57:26.818927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815275008,"internally_reserved":0,"allocated":3396218880,"data_stored":3396218880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815406080,"internally_reserved":0,"allocated":3396087808,"data_stored":3396087808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":759472,"kb_used_data":759472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51538256,"statfs":{"total":53552873472,"available":52775174144,"internally_reserved":0,"allocated":777699328,"data_stored":777699328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":769416,"kb_used_data":769416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51528312,"statfs":{"total":53552873472,"available":52764991488,"internally_reserved":0,"allocated":787881984,"data_stored":787881984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":888600,"kb_used_data":888600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51409128,"statfs":{"total":53552873472,"available":52642947072,"internally_reserved":0,"allocated":909926400,"data_stored":909926400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":879208,"kb_used_data":879208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51418520,"statfs":{"total":53552873472,"available":52652564480,"internally_reserved":0,"allocated":900308992,"data_stored":900308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52763807744,"internally_reserved":0,"allocated":789065728,"data_stored":789065728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52763676672,"internally_reserved":0,"allocated":789196800,"data_stored":789196800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:02.762 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:58:02.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:02.762 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:02.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.929+0000 7f838c47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:02.945+0000 7f838c47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:03.074 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:03.074 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:03.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:03.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.222+0000 7f47fad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.234+0000 7f47fad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:03.371 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:03.372 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:03.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:03.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.547+0000 7f4299a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.564+0000 7f4299a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:03.647 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:03.648 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:03.652 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:03.653 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:03.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:03.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.827+0000 7f3822551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:03.839+0000 7f3822551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.871 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:03.871 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:03.871 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:03.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:03.877 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:04.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:04.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:04.974+0000 7f15fa508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:04.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:04.984+0000 7f15fa508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:07.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:07.815+0000 7fbf904d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:07.825+0000 7fbf904d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:08.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:08.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:08.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:09.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:09.045+0000 7fad37391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:09.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:09.057+0000 7fad37391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:09.434 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:09.434 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:09.457 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-16T16:58:07.899782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3296696,"kb_used_data":3296696,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":205894216,"statfs":{"total":214211493888,"available":210835677184,"internally_reserved":0,"allocated":3375816704,"data_stored":3375816704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001538"},"pg_stats":[{"pgid":"6.f","version":"72'567","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.400634+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:43.400634+0000","last_peered":"2024-09-16T16:57:43.400634+0000","last_clean":"2024-09-16T16:57:43.400634+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:43.400634+0000","last_undegraded":"2024-09-16T16:57:43.400634+0000","last_fullsized":"2024-09-16T16:57:43.400634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"72'517","reported_seq":571,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.634764+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:57:43.634764+0000","last_peered":"2024-09-16T16:57:43.634764+0000","last_clean":"2024-09-16T16:57:43.634764+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:57:43.634764+0000","last_undegraded":"2024-09-16T16:57:43.634764+0000","last_fullsized":"2024-09-16T16:57:43.634764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"72'539","reported_seq":593,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.614162+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:57:43.614162+0000","last_peered":"2024-09-16T16:57:43.614162+0000","last_clean":"2024-09-16T16:57:43.614162+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:57:43.614162+0000","last_undegraded":"2024-09-16T16:57:43.614162+0000","last_fullsized":"2024-09-16T16:57:43.614162+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35323904,"num_objects":539,"num_object_clones":0,"num_object_copies":1617,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"72'569","reported_seq":623,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.567501+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:57:43.567501+0000","last_peered":"2024-09-16T16:57:43.567501+0000","last_clean":"2024-09-16T16:57:43.567501+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:57:43.567501+0000","last_undegraded":"2024-09-16T16:57:43.567501+0000","last_fullsized":"2024-09-16T16:57:43.567501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37289984,"num_objects":569,"num_object_clones":0,"num_object_copies":1707,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":36416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"72'553","reported_seq":607,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.651605+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:57:43.651605+0000","last_peered":"2024-09-16T16:57:43.651605+0000","last_clean":"2024-09-16T16:57:43.651605+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:57:43.651605+0000","last_undegraded":"2024-09-16T16:57:43.651605+0000","last_fullsized":"2024-09-16T16:57:43.651605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'533","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.808221+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:43.808221+0000","last_peered":"2024-09-16T16:57:43.808221+0000","last_clean":"2024-09-16T16:57:43.808221+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:43.808221+0000","last_undegraded":"2024-09-16T16:57:43.808221+0000","last_fullsized":"2024-09-16T16:57:43.808221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"72'538","reported_seq":592,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.517582+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:57:43.517582+0000","last_peered":"2024-09-16T16:57:43.517582+0000","last_clean":"2024-09-16T16:57:43.517582+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:57:43.517582+0000","last_undegraded":"2024-09-16T16:57:43.517582+0000","last_fullsized":"2024-09-16T16:57:43.517582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"72'557","reported_seq":611,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.662431+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:57:43.662431+0000","last_peered":"2024-09-16T16:57:43.662431+0000","last_clean":"2024-09-16T16:57:43.662431+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:57:43.662431+0000","last_undegraded":"2024-09-16T16:57:43.662431+0000","last_fullsized":"2024-09-16T16:57:43.662431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.584473+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:57:43.584473+0000","last_peered":"2024-09-16T16:57:43.584473+0000","last_clean":"2024-09-16T16:57:43.584473+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:57:43.584473+0000","last_undegraded":"2024-09-16T16:57:43.584473+0000","last_fullsized":"2024-09-16T16:57:43.584473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.845263+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:57:26.845263+0000","last_peered":"2024-09-16T16:57:26.845263+0000","last_clean":"2024-09-16T16:57:26.845263+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:57:26.845263+0000","last_undegraded":"2024-09-16T16:57:26.845263+0000","last_fullsized":"2024-09-16T16:57:26.845263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.823663+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:57:26.823663+0000","last_peered":"2024-09-16T16:57:26.823663+0000","last_clean":"2024-09-16T16:57:26.823663+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:57:26.823663+0000","last_undegraded":"2024-09-16T16:57:26.823663+0000","last_fullsized":"2024-09-16T16:57:26.823663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"72'530","reported_seq":584,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.581998+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:57:43.581998+0000","last_peered":"2024-09-16T16:57:43.581998+0000","last_clean":"2024-09-16T16:57:43.581998+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:57:43.581998+0000","last_undegraded":"2024-09-16T16:57:43.581998+0000","last_fullsized":"2024-09-16T16:57:43.581998+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":33920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.922359+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:57:26.922359+0000","last_peered":"2024-09-16T16:57:26.922359+0000","last_clean":"2024-09-16T16:57:26.922359+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:57:26.922359+0000","last_undegraded":"2024-09-16T16:57:26.922359+0000","last_fullsized":"2024-09-16T16:57:26.922359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'560","reported_seq":614,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.576613+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:43.576613+0000","last_peered":"2024-09-16T16:57:43.576613+0000","last_clean":"2024-09-16T16:57:43.576613+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:43.576613+0000","last_undegraded":"2024-09-16T16:57:43.576613+0000","last_fullsized":"2024-09-16T16:57:43.576613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.814644+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:57:26.814644+0000","last_peered":"2024-09-16T16:57:26.814644+0000","last_clean":"2024-09-16T16:57:26.814644+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:57:26.814644+0000","last_undegraded":"2024-09-16T16:57:26.814644+0000","last_fullsized":"2024-09-16T16:57:26.814644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"72'536","reported_seq":590,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.724571+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:57:43.724571+0000","last_peered":"2024-09-16T16:57:43.724571+0000","last_clean":"2024-09-16T16:57:43.724571+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:57:43.724571+0000","last_undegraded":"2024-09-16T16:57:43.724571+0000","last_fullsized":"2024-09-16T16:57:43.724571+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.918423+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:57:26.918423+0000","last_peered":"2024-09-16T16:57:26.918423+0000","last_clean":"2024-09-16T16:57:26.918423+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:57:26.918423+0000","last_undegraded":"2024-09-16T16:57:26.918423+0000","last_fullsized":"2024-09-16T16:57:26.918423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.640952+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:43.640952+0000","last_peered":"2024-09-16T16:57:43.640952+0000","last_clean":"2024-09-16T16:57:43.640952+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:43.640952+0000","last_undegraded":"2024-09-16T16:57:43.640952+0000","last_fullsized":"2024-09-16T16:57:43.640952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.831448+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:26.831448+0000","last_peered":"2024-09-16T16:57:26.831448+0000","last_clean":"2024-09-16T16:57:26.831448+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:26.831448+0000","last_undegraded":"2024-09-16T16:57:26.831448+0000","last_fullsized":"2024-09-16T16:57:26.831448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.800549+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:43.800549+0000","last_peered":"2024-09-16T16:57:43.800549+0000","last_clean":"2024-09-16T16:57:43.800549+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:43.800549+0000","last_undegraded":"2024-09-16T16:57:43.800549+0000","last_fullsized":"2024-09-16T16:57:43.800549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.851274+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:57:26.851274+0000","last_peered":"2024-09-16T16:57:26.851274+0000","last_clean":"2024-09-16T16:57:26.851274+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:57:26.851274+0000","last_undegraded":"2024-09-16T16:57:26.851274+0000","last_fullsized":"2024-09-16T16:57:26.851274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"72'515","reported_seq":569,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.322153+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:57:43.322153+0000","last_peered":"2024-09-16T16:57:43.322153+0000","last_clean":"2024-09-16T16:57:43.322153+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:57:43.322153+0000","last_undegraded":"2024-09-16T16:57:43.322153+0000","last_fullsized":"2024-09-16T16:57:43.322153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.824101+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:26.824101+0000","last_peered":"2024-09-16T16:57:26.824101+0000","last_clean":"2024-09-16T16:57:26.824101+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:26.824101+0000","last_undegraded":"2024-09-16T16:57:26.824101+0000","last_fullsized":"2024-09-16T16:57:26.824101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"72'478","reported_seq":532,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.207691+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:57:43.207691+0000","last_peered":"2024-09-16T16:57:43.207691+0000","last_clean":"2024-09-16T16:57:43.207691+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:57:43.207691+0000","last_undegraded":"2024-09-16T16:57:43.207691+0000","last_fullsized":"2024-09-16T16:57:43.207691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.818927+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:57:26.818927+0000","last_peered":"2024-09-16T16:57:26.818927+0000","last_clean":"2024-09-16T16:57:26.818927+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:57:26.818927+0000","last_undegraded":"2024-09-16T16:57:26.818927+0000","last_fullsized":"2024-09-16T16:57:26.818927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815275008,"internally_reserved":0,"allocated":3396218880,"data_stored":3396218880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":210815406080,"internally_reserved":0,"allocated":3396087808,"data_stored":3396087808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":759472,"kb_used_data":759472,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51538256,"statfs":{"total":53552873472,"available":52775174144,"internally_reserved":0,"allocated":777699328,"data_stored":777699328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":769416,"kb_used_data":769416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51528312,"statfs":{"total":53552873472,"available":52764991488,"internally_reserved":0,"allocated":787881984,"data_stored":787881984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":888600,"kb_used_data":888600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51409128,"statfs":{"total":53552873472,"available":52642947072,"internally_reserved":0,"allocated":909926400,"data_stored":909926400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":879208,"kb_used_data":879208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51418520,"statfs":{"total":53552873472,"available":52652564480,"internally_reserved":0,"allocated":900308992,"data_stored":900308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52763807744,"internally_reserved":0,"allocated":789065728,"data_stored":789065728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52641390592,"internally_reserved":0,"allocated":911482880,"data_stored":911482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52638961664,"internally_reserved":0,"allocated":913911808,"data_stored":913911808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52763676672,"internally_reserved":0,"allocated":789196800,"data_stored":789196800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52771246080,"internally_reserved":0,"allocated":781627392,"data_stored":781627392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:10.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:10.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:10.384+0000 7f8caead1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:10.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:10.394+0000 7f8caead1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:12.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:13.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:13.117+0000 7fbc494bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:13.124+0000 7fbc494bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:14.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:14.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:14.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:14.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:14.630+0000 7f9f8a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:14.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:14.646+0000 7f9f8a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:14.990 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:15.013 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-09-16T16:58:13.901053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508559947,"num_objects":7756,"num_object_clones":0,"num_object_copies":23268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11059,"num_write_kb":600405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11033,"ondisk_log_size":11033,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2995024,"kb_used_data":2995024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206195888,"statfs":{"total":214211493888,"available":211144589312,"internally_reserved":0,"allocated":3066904576,"data_stored":3066904576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52101096,"num_objects":-794,"num_object_clones":0,"num_object_copies":-2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2432,"num_write_kb":52353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002415"},"pg_stats":[{"pgid":"6.f","version":"72'567","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.400634+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:57:43.400634+0000","last_peered":"2024-09-16T16:57:43.400634+0000","last_clean":"2024-09-16T16:57:43.400634+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:57:43.400634+0000","last_undegraded":"2024-09-16T16:57:43.400634+0000","last_fullsized":"2024-09-16T16:57:43.400634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37158912,"num_objects":567,"num_object_clones":0,"num_object_copies":1701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'738","reported_seq":804,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.647282+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:13.647282+0000","last_peered":"2024-09-16T16:58:13.647282+0000","last_clean":"2024-09-16T16:58:13.647282+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:13.647282+0000","last_undegraded":"2024-09-16T16:58:13.647282+0000","last_fullsized":"2024-09-16T16:58:13.647282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'750","reported_seq":817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.609816+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:13.609816+0000","last_peered":"2024-09-16T16:58:13.609816+0000","last_clean":"2024-09-16T16:58:13.609816+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:13.609816+0000","last_undegraded":"2024-09-16T16:58:13.609816+0000","last_fullsized":"2024-09-16T16:58:13.609816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867480,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":750,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'805","reported_seq":871,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.786931+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:13.786931+0000","last_peered":"2024-09-16T16:58:13.786931+0000","last_clean":"2024-09-16T16:58:13.786931+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:13.786931+0000","last_undegraded":"2024-09-16T16:58:13.786931+0000","last_fullsized":"2024-09-16T16:58:13.786931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'782","reported_seq":848,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.574216+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:13.574216+0000","last_peered":"2024-09-16T16:58:13.574216+0000","last_clean":"2024-09-16T16:58:13.574216+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:13.574216+0000","last_undegraded":"2024-09-16T16:58:13.574216+0000","last_fullsized":"2024-09-16T16:58:13.574216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"72'533","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.808221+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:57:43.808221+0000","last_peered":"2024-09-16T16:57:43.808221+0000","last_clean":"2024-09-16T16:57:43.808221+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:57:43.808221+0000","last_undegraded":"2024-09-16T16:57:43.808221+0000","last_fullsized":"2024-09-16T16:57:43.808221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'756","reported_seq":822,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.504554+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:13.504554+0000","last_peered":"2024-09-16T16:58:13.504554+0000","last_clean":"2024-09-16T16:58:13.504554+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:13.504554+0000","last_undegraded":"2024-09-16T16:58:13.504554+0000","last_fullsized":"2024-09-16T16:58:13.504554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.757574+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:13.757574+0000","last_peered":"2024-09-16T16:58:13.757574+0000","last_clean":"2024-09-16T16:58:13.757574+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:13.757574+0000","last_undegraded":"2024-09-16T16:58:13.757574+0000","last_fullsized":"2024-09-16T16:58:13.757574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'753","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.640315+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:13.640315+0000","last_peered":"2024-09-16T16:58:13.640315+0000","last_clean":"2024-09-16T16:58:13.640315+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:13.640315+0000","last_undegraded":"2024-09-16T16:58:13.640315+0000","last_fullsized":"2024-09-16T16:58:13.640315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.807469+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:01.807469+0000","last_peered":"2024-09-16T16:58:01.807469+0000","last_clean":"2024-09-16T16:58:01.807469+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:01.807469+0000","last_undegraded":"2024-09-16T16:58:01.807469+0000","last_fullsized":"2024-09-16T16:58:01.807469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.791422+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:01.791422+0000","last_peered":"2024-09-16T16:58:01.791422+0000","last_clean":"2024-09-16T16:58:01.791422+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:01.791422+0000","last_undegraded":"2024-09-16T16:58:01.791422+0000","last_fullsized":"2024-09-16T16:58:01.791422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'746","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.389599+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:13.389599+0000","last_peered":"2024-09-16T16:58:13.389599+0000","last_clean":"2024-09-16T16:58:13.389599+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:13.389599+0000","last_undegraded":"2024-09-16T16:58:13.389599+0000","last_fullsized":"2024-09-16T16:58:13.389599+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.866489+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:01.866489+0000","last_peered":"2024-09-16T16:58:01.866489+0000","last_clean":"2024-09-16T16:58:01.866489+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:01.866489+0000","last_undegraded":"2024-09-16T16:58:01.866489+0000","last_fullsized":"2024-09-16T16:58:01.866489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"72'560","reported_seq":614,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.576613+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:57:43.576613+0000","last_peered":"2024-09-16T16:57:43.576613+0000","last_clean":"2024-09-16T16:57:43.576613+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:57:43.576613+0000","last_undegraded":"2024-09-16T16:57:43.576613+0000","last_fullsized":"2024-09-16T16:57:43.576613+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.785515+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:01.785515+0000","last_peered":"2024-09-16T16:58:01.785515+0000","last_clean":"2024-09-16T16:58:01.785515+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:01.785515+0000","last_undegraded":"2024-09-16T16:58:01.785515+0000","last_fullsized":"2024-09-16T16:58:01.785515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'757","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.538228+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:13.538228+0000","last_peered":"2024-09-16T16:58:13.538228+0000","last_clean":"2024-09-16T16:58:13.538228+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:13.538228+0000","last_undegraded":"2024-09-16T16:58:13.538228+0000","last_fullsized":"2024-09-16T16:58:13.538228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.869999+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:01.869999+0000","last_peered":"2024-09-16T16:58:01.869999+0000","last_clean":"2024-09-16T16:58:01.869999+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:01.869999+0000","last_undegraded":"2024-09-16T16:58:01.869999+0000","last_fullsized":"2024-09-16T16:58:01.869999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.640952+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:57:43.640952+0000","last_peered":"2024-09-16T16:57:43.640952+0000","last_clean":"2024-09-16T16:57:43.640952+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:57:43.640952+0000","last_undegraded":"2024-09-16T16:57:43.640952+0000","last_fullsized":"2024-09-16T16:57:43.640952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.831448+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:57:26.831448+0000","last_peered":"2024-09-16T16:57:26.831448+0000","last_clean":"2024-09-16T16:57:26.831448+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:57:26.831448+0000","last_undegraded":"2024-09-16T16:57:26.831448+0000","last_fullsized":"2024-09-16T16:57:26.831448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"72'518","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:43.800549+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:57:43.800549+0000","last_peered":"2024-09-16T16:57:43.800549+0000","last_clean":"2024-09-16T16:57:43.800549+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:57:43.800549+0000","last_undegraded":"2024-09-16T16:57:43.800549+0000","last_fullsized":"2024-09-16T16:57:43.800549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.814449+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:01.814449+0000","last_peered":"2024-09-16T16:58:01.814449+0000","last_clean":"2024-09-16T16:58:01.814449+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:01.814449+0000","last_undegraded":"2024-09-16T16:58:01.814449+0000","last_fullsized":"2024-09-16T16:58:01.814449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'720","reported_seq":786,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.332604+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:13.332604+0000","last_peered":"2024-09-16T16:58:13.332604+0000","last_clean":"2024-09-16T16:58:13.332604+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:13.332604+0000","last_undegraded":"2024-09-16T16:58:13.332604+0000","last_fullsized":"2024-09-16T16:58:13.332604+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:57:26.824101+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:57:26.824101+0000","last_peered":"2024-09-16T16:57:26.824101+0000","last_clean":"2024-09-16T16:57:26.824101+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:57:26.824101+0000","last_undegraded":"2024-09-16T16:57:26.824101+0000","last_fullsized":"2024-09-16T16:57:26.824101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'708","reported_seq":774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.681177+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:13.681177+0000","last_peered":"2024-09-16T16:58:13.681177+0000","last_clean":"2024-09-16T16:58:13.681177+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:13.681177+0000","last_undegraded":"2024-09-16T16:58:13.681177+0000","last_fullsized":"2024-09-16T16:58:13.681177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.790754+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:01.790754+0000","last_peered":"2024-09-16T16:58:01.790754+0000","last_clean":"2024-09-16T16:58:01.790754+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:01.790754+0000","last_undegraded":"2024-09-16T16:58:01.790754+0000","last_fullsized":"2024-09-16T16:58:01.790754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":507969560,"num_objects":7752,"num_object_clones":0,"num_object_copies":23256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10978,"num_write_kb":599297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211162722304,"internally_reserved":0,"allocated":3048771584,"data_stored":3048771584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10978,"ondisk_log_size":10978,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211162591232,"internally_reserved":0,"allocated":3048902656,"data_stored":3048902656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662708,"kb_used_data":662708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635020,"statfs":{"total":53552873472,"available":52874260480,"internally_reserved":0,"allocated":678612992,"data_stored":678612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":769416,"kb_used_data":769416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51528312,"statfs":{"total":53552873472,"available":52764991488,"internally_reserved":0,"allocated":787881984,"data_stored":787881984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":777380,"kb_used_data":777380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51520348,"statfs":{"total":53552873472,"available":52756836352,"internally_reserved":0,"allocated":796037120,"data_stored":796037120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":785520,"kb_used_data":785520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51512208,"statfs":{"total":53552873472,"available":52748500992,"internally_reserved":0,"allocated":804372480,"data_stored":804372480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52759126016,"internally_reserved":0,"allocated":793747456,"data_stored":793747456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52763807744,"internally_reserved":0,"allocated":789065728,"data_stored":789065728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52759257088,"internally_reserved":0,"allocated":793616384,"data_stored":793616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52763676672,"internally_reserved":0,"allocated":789196800,"data_stored":789196800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52878217216,"internally_reserved":0,"allocated":674656256,"data_stored":674656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:15.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:15.755+0000 7fe6e8c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:15.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:15.765+0000 7fe6e8c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:18.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:18.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:18.354+0000 7f5763748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:18.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:18.363+0000 7f5763748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:20.015 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:20.016 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:20.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:20.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.184+0000 7f96d1e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.201+0000 7f96d1e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:20.385 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:20.388 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:20.389 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:20.389 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:20.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.563+0000 7f533f108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.580+0000 7f533f108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:20.693 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:20.693 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:20.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:20.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:20.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.866+0000 7f9ca3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.884+0000 7f9ca1f2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.913+0000 7f7c37111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:20.924+0000 7f7c35eaf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:20.975 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:20.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:20.979 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:20.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:21.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:21.119+0000 7f81b7893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:21.137+0000 7f81b7893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:21.173 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:21.174 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:23.447 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:23.625+0000 7f45fcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:23.636+0000 7f45fcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:26.175 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:26.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:58:26.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.276+0000 7f1b05ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.286+0000 7f1b05ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.340+0000 7fbb60823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.356+0000 7fbb60823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.752 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:58:26.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:58:26.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.928+0000 7f82032fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:26.947+0000 7f82032fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.763 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:58:27.792 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:58:27.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:27.944+0000 7fafbc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:27.958+0000 7fafbc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:28.782 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:58:28.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:58:28.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:28.976+0000 7f0474191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:28.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:28.998+0000 7f0474191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:29.025+0000 7ff9d64b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:29.034+0000 7ff9d5252640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.791 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:58:29.814 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:58:29.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:29.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:29.957+0000 7f2470511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:29.969+0000 7f2470511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.263 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:30.265 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:30.287 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-16T16:58:29.904600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":482017867,"num_objects":7351,"num_object_clones":0,"num_object_copies":22053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12192,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12166,"ondisk_log_size":12166,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2887648,"kb_used_data":2887648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206303264,"statfs":{"total":214211493888,"available":211254542336,"internally_reserved":0,"allocated":2956951552,"data_stored":2956951552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000878"},"pg_stats":[{"pgid":"6.f","version":"76'788","reported_seq":854,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.794456+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:13.794456+0000","last_peered":"2024-09-16T16:58:13.794456+0000","last_clean":"2024-09-16T16:58:13.794456+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:13.794456+0000","last_undegraded":"2024-09-16T16:58:13.794456+0000","last_fullsized":"2024-09-16T16:58:13.794456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'738","reported_seq":804,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.647282+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:13.647282+0000","last_peered":"2024-09-16T16:58:13.647282+0000","last_clean":"2024-09-16T16:58:13.647282+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:13.647282+0000","last_undegraded":"2024-09-16T16:58:13.647282+0000","last_fullsized":"2024-09-16T16:58:13.647282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'750","reported_seq":817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.609816+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:13.609816+0000","last_peered":"2024-09-16T16:58:13.609816+0000","last_clean":"2024-09-16T16:58:13.609816+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:13.609816+0000","last_undegraded":"2024-09-16T16:58:13.609816+0000","last_fullsized":"2024-09-16T16:58:13.609816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867480,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":750,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'805","reported_seq":871,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.786931+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:13.786931+0000","last_peered":"2024-09-16T16:58:13.786931+0000","last_clean":"2024-09-16T16:58:13.786931+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:13.786931+0000","last_undegraded":"2024-09-16T16:58:13.786931+0000","last_fullsized":"2024-09-16T16:58:13.786931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'782","reported_seq":848,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.574216+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:13.574216+0000","last_peered":"2024-09-16T16:58:13.574216+0000","last_clean":"2024-09-16T16:58:13.574216+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:13.574216+0000","last_undegraded":"2024-09-16T16:58:13.574216+0000","last_fullsized":"2024-09-16T16:58:13.574216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'743","reported_seq":809,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.826680+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:13.826680+0000","last_peered":"2024-09-16T16:58:13.826680+0000","last_clean":"2024-09-16T16:58:13.826680+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:13.826680+0000","last_undegraded":"2024-09-16T16:58:13.826680+0000","last_fullsized":"2024-09-16T16:58:13.826680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'756","reported_seq":822,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.504554+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:13.504554+0000","last_peered":"2024-09-16T16:58:13.504554+0000","last_clean":"2024-09-16T16:58:13.504554+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:13.504554+0000","last_undegraded":"2024-09-16T16:58:13.504554+0000","last_fullsized":"2024-09-16T16:58:13.504554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.757574+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:13.757574+0000","last_peered":"2024-09-16T16:58:13.757574+0000","last_clean":"2024-09-16T16:58:13.757574+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:13.757574+0000","last_undegraded":"2024-09-16T16:58:13.757574+0000","last_fullsized":"2024-09-16T16:58:13.757574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'753","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.640315+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:13.640315+0000","last_peered":"2024-09-16T16:58:13.640315+0000","last_clean":"2024-09-16T16:58:13.640315+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:13.640315+0000","last_undegraded":"2024-09-16T16:58:13.640315+0000","last_fullsized":"2024-09-16T16:58:13.640315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.807469+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:01.807469+0000","last_peered":"2024-09-16T16:58:01.807469+0000","last_clean":"2024-09-16T16:58:01.807469+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:01.807469+0000","last_undegraded":"2024-09-16T16:58:01.807469+0000","last_fullsized":"2024-09-16T16:58:01.807469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.791422+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:01.791422+0000","last_peered":"2024-09-16T16:58:01.791422+0000","last_clean":"2024-09-16T16:58:01.791422+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:01.791422+0000","last_undegraded":"2024-09-16T16:58:01.791422+0000","last_fullsized":"2024-09-16T16:58:01.791422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'746","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.389599+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:13.389599+0000","last_peered":"2024-09-16T16:58:13.389599+0000","last_clean":"2024-09-16T16:58:13.389599+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:13.389599+0000","last_undegraded":"2024-09-16T16:58:13.389599+0000","last_fullsized":"2024-09-16T16:58:13.389599+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.866489+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:01.866489+0000","last_peered":"2024-09-16T16:58:01.866489+0000","last_clean":"2024-09-16T16:58:01.866489+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:01.866489+0000","last_undegraded":"2024-09-16T16:58:01.866489+0000","last_fullsized":"2024-09-16T16:58:01.866489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'799","reported_seq":865,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.836110+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:13.836110+0000","last_peered":"2024-09-16T16:58:13.836110+0000","last_clean":"2024-09-16T16:58:13.836110+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:13.836110+0000","last_undegraded":"2024-09-16T16:58:13.836110+0000","last_fullsized":"2024-09-16T16:58:13.836110+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.785515+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:01.785515+0000","last_peered":"2024-09-16T16:58:01.785515+0000","last_clean":"2024-09-16T16:58:01.785515+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:01.785515+0000","last_undegraded":"2024-09-16T16:58:01.785515+0000","last_fullsized":"2024-09-16T16:58:01.785515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'757","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.538228+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:13.538228+0000","last_peered":"2024-09-16T16:58:13.538228+0000","last_clean":"2024-09-16T16:58:13.538228+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:13.538228+0000","last_undegraded":"2024-09-16T16:58:13.538228+0000","last_fullsized":"2024-09-16T16:58:13.538228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.869999+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:01.869999+0000","last_peered":"2024-09-16T16:58:01.869999+0000","last_clean":"2024-09-16T16:58:01.869999+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:01.869999+0000","last_undegraded":"2024-09-16T16:58:01.869999+0000","last_fullsized":"2024-09-16T16:58:01.869999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'739","reported_seq":805,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.255775+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:13.255775+0000","last_peered":"2024-09-16T16:58:13.255775+0000","last_clean":"2024-09-16T16:58:13.255775+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:13.255775+0000","last_undegraded":"2024-09-16T16:58:13.255775+0000","last_fullsized":"2024-09-16T16:58:13.255775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.029355+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:02.029355+0000","last_peered":"2024-09-16T16:58:02.029355+0000","last_clean":"2024-09-16T16:58:02.029355+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:02.029355+0000","last_undegraded":"2024-09-16T16:58:02.029355+0000","last_fullsized":"2024-09-16T16:58:02.029355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'760","reported_seq":826,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.726625+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:13.726625+0000","last_peered":"2024-09-16T16:58:13.726625+0000","last_clean":"2024-09-16T16:58:13.726625+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:13.726625+0000","last_undegraded":"2024-09-16T16:58:13.726625+0000","last_fullsized":"2024-09-16T16:58:13.726625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.814449+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:01.814449+0000","last_peered":"2024-09-16T16:58:01.814449+0000","last_clean":"2024-09-16T16:58:01.814449+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:01.814449+0000","last_undegraded":"2024-09-16T16:58:01.814449+0000","last_fullsized":"2024-09-16T16:58:01.814449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'720","reported_seq":786,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.332604+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:13.332604+0000","last_peered":"2024-09-16T16:58:13.332604+0000","last_clean":"2024-09-16T16:58:13.332604+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:13.332604+0000","last_undegraded":"2024-09-16T16:58:13.332604+0000","last_fullsized":"2024-09-16T16:58:13.332604+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.027365+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:02.027365+0000","last_peered":"2024-09-16T16:58:02.027365+0000","last_clean":"2024-09-16T16:58:02.027365+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:02.027365+0000","last_undegraded":"2024-09-16T16:58:02.027365+0000","last_fullsized":"2024-09-16T16:58:02.027365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'708","reported_seq":774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.681177+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:13.681177+0000","last_peered":"2024-09-16T16:58:13.681177+0000","last_clean":"2024-09-16T16:58:13.681177+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:13.681177+0000","last_undegraded":"2024-09-16T16:58:13.681177+0000","last_fullsized":"2024-09-16T16:58:13.681177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.790754+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:01.790754+0000","last_peered":"2024-09-16T16:58:01.790754+0000","last_clean":"2024-09-16T16:58:01.790754+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:01.790754+0000","last_undegraded":"2024-09-16T16:58:01.790754+0000","last_fullsized":"2024-09-16T16:58:01.790754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":481427480,"num_objects":7347,"num_object_clones":0,"num_object_copies":22041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12111,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274776576,"internally_reserved":0,"allocated":2936717312,"data_stored":2936717312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12111,"ondisk_log_size":12111,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274514432,"internally_reserved":0,"allocated":2936979456,"data_stored":2936979456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662708,"kb_used_data":662708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635020,"statfs":{"total":53552873472,"available":52874260480,"internally_reserved":0,"allocated":678612992,"data_stored":678612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662040,"kb_used_data":662040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635688,"statfs":{"total":53552873472,"available":52874944512,"internally_reserved":0,"allocated":677928960,"data_stored":677928960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":777380,"kb_used_data":777380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51520348,"statfs":{"total":53552873472,"available":52756836352,"internally_reserved":0,"allocated":796037120,"data_stored":796037120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":785520,"kb_used_data":785520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51512208,"statfs":{"total":53552873472,"available":52748500992,"internally_reserved":0,"allocated":804372480,"data_stored":804372480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52759126016,"internally_reserved":0,"allocated":793747456,"data_stored":793747456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52759257088,"internally_reserved":0,"allocated":793616384,"data_stored":793616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52878217216,"internally_reserved":0,"allocated":674656256,"data_stored":674656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:30.289 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:30.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:30.459+0000 7f3a57aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:30.474+0000 7f3a57aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:30.827 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:30.850 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-16T16:58:29.904600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":482017867,"num_objects":7351,"num_object_clones":0,"num_object_copies":22053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12192,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12166,"ondisk_log_size":12166,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2887648,"kb_used_data":2887648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206303264,"statfs":{"total":214211493888,"available":211254542336,"internally_reserved":0,"allocated":2956951552,"data_stored":2956951552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000878"},"pg_stats":[{"pgid":"6.f","version":"76'788","reported_seq":854,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.794456+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:13.794456+0000","last_peered":"2024-09-16T16:58:13.794456+0000","last_clean":"2024-09-16T16:58:13.794456+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:13.794456+0000","last_undegraded":"2024-09-16T16:58:13.794456+0000","last_fullsized":"2024-09-16T16:58:13.794456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'738","reported_seq":804,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.647282+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:13.647282+0000","last_peered":"2024-09-16T16:58:13.647282+0000","last_clean":"2024-09-16T16:58:13.647282+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:13.647282+0000","last_undegraded":"2024-09-16T16:58:13.647282+0000","last_fullsized":"2024-09-16T16:58:13.647282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'750","reported_seq":817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.609816+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:13.609816+0000","last_peered":"2024-09-16T16:58:13.609816+0000","last_clean":"2024-09-16T16:58:13.609816+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:13.609816+0000","last_undegraded":"2024-09-16T16:58:13.609816+0000","last_fullsized":"2024-09-16T16:58:13.609816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867480,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":750,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'805","reported_seq":871,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.786931+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:13.786931+0000","last_peered":"2024-09-16T16:58:13.786931+0000","last_clean":"2024-09-16T16:58:13.786931+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:13.786931+0000","last_undegraded":"2024-09-16T16:58:13.786931+0000","last_fullsized":"2024-09-16T16:58:13.786931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'782","reported_seq":848,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.574216+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:13.574216+0000","last_peered":"2024-09-16T16:58:13.574216+0000","last_clean":"2024-09-16T16:58:13.574216+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:13.574216+0000","last_undegraded":"2024-09-16T16:58:13.574216+0000","last_fullsized":"2024-09-16T16:58:13.574216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'743","reported_seq":809,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.826680+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:13.826680+0000","last_peered":"2024-09-16T16:58:13.826680+0000","last_clean":"2024-09-16T16:58:13.826680+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:13.826680+0000","last_undegraded":"2024-09-16T16:58:13.826680+0000","last_fullsized":"2024-09-16T16:58:13.826680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'756","reported_seq":822,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.504554+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:13.504554+0000","last_peered":"2024-09-16T16:58:13.504554+0000","last_clean":"2024-09-16T16:58:13.504554+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:13.504554+0000","last_undegraded":"2024-09-16T16:58:13.504554+0000","last_fullsized":"2024-09-16T16:58:13.504554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.757574+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:13.757574+0000","last_peered":"2024-09-16T16:58:13.757574+0000","last_clean":"2024-09-16T16:58:13.757574+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:13.757574+0000","last_undegraded":"2024-09-16T16:58:13.757574+0000","last_fullsized":"2024-09-16T16:58:13.757574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'753","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.640315+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:13.640315+0000","last_peered":"2024-09-16T16:58:13.640315+0000","last_clean":"2024-09-16T16:58:13.640315+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:13.640315+0000","last_undegraded":"2024-09-16T16:58:13.640315+0000","last_fullsized":"2024-09-16T16:58:13.640315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.807469+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:01.807469+0000","last_peered":"2024-09-16T16:58:01.807469+0000","last_clean":"2024-09-16T16:58:01.807469+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:01.807469+0000","last_undegraded":"2024-09-16T16:58:01.807469+0000","last_fullsized":"2024-09-16T16:58:01.807469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.791422+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:01.791422+0000","last_peered":"2024-09-16T16:58:01.791422+0000","last_clean":"2024-09-16T16:58:01.791422+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:01.791422+0000","last_undegraded":"2024-09-16T16:58:01.791422+0000","last_fullsized":"2024-09-16T16:58:01.791422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'746","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.389599+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:13.389599+0000","last_peered":"2024-09-16T16:58:13.389599+0000","last_clean":"2024-09-16T16:58:13.389599+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:13.389599+0000","last_undegraded":"2024-09-16T16:58:13.389599+0000","last_fullsized":"2024-09-16T16:58:13.389599+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.866489+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:01.866489+0000","last_peered":"2024-09-16T16:58:01.866489+0000","last_clean":"2024-09-16T16:58:01.866489+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:01.866489+0000","last_undegraded":"2024-09-16T16:58:01.866489+0000","last_fullsized":"2024-09-16T16:58:01.866489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'799","reported_seq":865,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.836110+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:13.836110+0000","last_peered":"2024-09-16T16:58:13.836110+0000","last_clean":"2024-09-16T16:58:13.836110+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:13.836110+0000","last_undegraded":"2024-09-16T16:58:13.836110+0000","last_fullsized":"2024-09-16T16:58:13.836110+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.785515+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:01.785515+0000","last_peered":"2024-09-16T16:58:01.785515+0000","last_clean":"2024-09-16T16:58:01.785515+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:01.785515+0000","last_undegraded":"2024-09-16T16:58:01.785515+0000","last_fullsized":"2024-09-16T16:58:01.785515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'757","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.538228+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:13.538228+0000","last_peered":"2024-09-16T16:58:13.538228+0000","last_clean":"2024-09-16T16:58:13.538228+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:13.538228+0000","last_undegraded":"2024-09-16T16:58:13.538228+0000","last_fullsized":"2024-09-16T16:58:13.538228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.869999+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:01.869999+0000","last_peered":"2024-09-16T16:58:01.869999+0000","last_clean":"2024-09-16T16:58:01.869999+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:01.869999+0000","last_undegraded":"2024-09-16T16:58:01.869999+0000","last_fullsized":"2024-09-16T16:58:01.869999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'739","reported_seq":805,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.255775+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:13.255775+0000","last_peered":"2024-09-16T16:58:13.255775+0000","last_clean":"2024-09-16T16:58:13.255775+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:13.255775+0000","last_undegraded":"2024-09-16T16:58:13.255775+0000","last_fullsized":"2024-09-16T16:58:13.255775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.029355+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:02.029355+0000","last_peered":"2024-09-16T16:58:02.029355+0000","last_clean":"2024-09-16T16:58:02.029355+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:02.029355+0000","last_undegraded":"2024-09-16T16:58:02.029355+0000","last_fullsized":"2024-09-16T16:58:02.029355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'760","reported_seq":826,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.726625+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:13.726625+0000","last_peered":"2024-09-16T16:58:13.726625+0000","last_clean":"2024-09-16T16:58:13.726625+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:13.726625+0000","last_undegraded":"2024-09-16T16:58:13.726625+0000","last_fullsized":"2024-09-16T16:58:13.726625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.814449+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:01.814449+0000","last_peered":"2024-09-16T16:58:01.814449+0000","last_clean":"2024-09-16T16:58:01.814449+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:01.814449+0000","last_undegraded":"2024-09-16T16:58:01.814449+0000","last_fullsized":"2024-09-16T16:58:01.814449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'720","reported_seq":786,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.332604+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:13.332604+0000","last_peered":"2024-09-16T16:58:13.332604+0000","last_clean":"2024-09-16T16:58:13.332604+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:13.332604+0000","last_undegraded":"2024-09-16T16:58:13.332604+0000","last_fullsized":"2024-09-16T16:58:13.332604+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.027365+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:02.027365+0000","last_peered":"2024-09-16T16:58:02.027365+0000","last_clean":"2024-09-16T16:58:02.027365+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:02.027365+0000","last_undegraded":"2024-09-16T16:58:02.027365+0000","last_fullsized":"2024-09-16T16:58:02.027365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'708","reported_seq":774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.681177+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:13.681177+0000","last_peered":"2024-09-16T16:58:13.681177+0000","last_clean":"2024-09-16T16:58:13.681177+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:13.681177+0000","last_undegraded":"2024-09-16T16:58:13.681177+0000","last_fullsized":"2024-09-16T16:58:13.681177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.790754+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:01.790754+0000","last_peered":"2024-09-16T16:58:01.790754+0000","last_clean":"2024-09-16T16:58:01.790754+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:01.790754+0000","last_undegraded":"2024-09-16T16:58:01.790754+0000","last_fullsized":"2024-09-16T16:58:01.790754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":481427480,"num_objects":7347,"num_object_clones":0,"num_object_copies":22041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12111,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274776576,"internally_reserved":0,"allocated":2936717312,"data_stored":2936717312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12111,"ondisk_log_size":12111,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274514432,"internally_reserved":0,"allocated":2936979456,"data_stored":2936979456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662708,"kb_used_data":662708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635020,"statfs":{"total":53552873472,"available":52874260480,"internally_reserved":0,"allocated":678612992,"data_stored":678612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662040,"kb_used_data":662040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635688,"statfs":{"total":53552873472,"available":52874944512,"internally_reserved":0,"allocated":677928960,"data_stored":677928960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":777380,"kb_used_data":777380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51520348,"statfs":{"total":53552873472,"available":52756836352,"internally_reserved":0,"allocated":796037120,"data_stored":796037120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":785520,"kb_used_data":785520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51512208,"statfs":{"total":53552873472,"available":52748500992,"internally_reserved":0,"allocated":804372480,"data_stored":804372480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52759126016,"internally_reserved":0,"allocated":793747456,"data_stored":793747456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52759257088,"internally_reserved":0,"allocated":793616384,"data_stored":793616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52878217216,"internally_reserved":0,"allocated":674656256,"data_stored":674656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:30.851 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:58:30.851 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:30.852 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:30.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:31.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.018+0000 7f13e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.031+0000 7f13e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:31.150 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:31.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:31.153 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:31.153 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:31.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.325+0000 7f8ad8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.338+0000 7f8ad8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:31.458 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:31.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:31.463 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:31.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:31.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:31.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.604+0000 7fc429f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.619+0000 7fc428d2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:31.727 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:31.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:31.733 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:31.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:31.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.745+0000 7fc50fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.763+0000 7fc50fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.937+0000 7f2b70d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:31.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:31.959+0000 7f2b70d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:32.015 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:58:32.016 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:58:32.020 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:32.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:34.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:34.391+0000 7f6333991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:34.397+0000 7f6333991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:36.962+0000 7f3961191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:36.969+0000 7f3961191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:37.021 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:37.021 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:37.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:37.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:37.166+0000 7fc226351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:37.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:37.176+0000 7fc226351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:37.513 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:37.535 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-09-16T16:58:35.905792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":482017867,"num_objects":7351,"num_object_clones":0,"num_object_copies":22053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12192,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12166,"ondisk_log_size":12166,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2887648,"kb_used_data":2887648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206303264,"statfs":{"total":214211493888,"available":211254542336,"internally_reserved":0,"allocated":2956951552,"data_stored":2956951552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001620"},"pg_stats":[{"pgid":"6.f","version":"76'788","reported_seq":854,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.794456+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:13.794456+0000","last_peered":"2024-09-16T16:58:13.794456+0000","last_clean":"2024-09-16T16:58:13.794456+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:13.794456+0000","last_undegraded":"2024-09-16T16:58:13.794456+0000","last_fullsized":"2024-09-16T16:58:13.794456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'738","reported_seq":804,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.647282+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:13.647282+0000","last_peered":"2024-09-16T16:58:13.647282+0000","last_clean":"2024-09-16T16:58:13.647282+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:13.647282+0000","last_undegraded":"2024-09-16T16:58:13.647282+0000","last_fullsized":"2024-09-16T16:58:13.647282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'750","reported_seq":817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.609816+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:13.609816+0000","last_peered":"2024-09-16T16:58:13.609816+0000","last_clean":"2024-09-16T16:58:13.609816+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:13.609816+0000","last_undegraded":"2024-09-16T16:58:13.609816+0000","last_fullsized":"2024-09-16T16:58:13.609816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867480,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":750,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'805","reported_seq":871,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.786931+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:13.786931+0000","last_peered":"2024-09-16T16:58:13.786931+0000","last_clean":"2024-09-16T16:58:13.786931+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:13.786931+0000","last_undegraded":"2024-09-16T16:58:13.786931+0000","last_fullsized":"2024-09-16T16:58:13.786931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'782","reported_seq":848,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.574216+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:13.574216+0000","last_peered":"2024-09-16T16:58:13.574216+0000","last_clean":"2024-09-16T16:58:13.574216+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:13.574216+0000","last_undegraded":"2024-09-16T16:58:13.574216+0000","last_fullsized":"2024-09-16T16:58:13.574216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'743","reported_seq":809,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.826680+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:13.826680+0000","last_peered":"2024-09-16T16:58:13.826680+0000","last_clean":"2024-09-16T16:58:13.826680+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:13.826680+0000","last_undegraded":"2024-09-16T16:58:13.826680+0000","last_fullsized":"2024-09-16T16:58:13.826680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'756","reported_seq":822,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.504554+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:13.504554+0000","last_peered":"2024-09-16T16:58:13.504554+0000","last_clean":"2024-09-16T16:58:13.504554+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:13.504554+0000","last_undegraded":"2024-09-16T16:58:13.504554+0000","last_fullsized":"2024-09-16T16:58:13.504554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.757574+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:13.757574+0000","last_peered":"2024-09-16T16:58:13.757574+0000","last_clean":"2024-09-16T16:58:13.757574+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:13.757574+0000","last_undegraded":"2024-09-16T16:58:13.757574+0000","last_fullsized":"2024-09-16T16:58:13.757574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'753","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.640315+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:13.640315+0000","last_peered":"2024-09-16T16:58:13.640315+0000","last_clean":"2024-09-16T16:58:13.640315+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:13.640315+0000","last_undegraded":"2024-09-16T16:58:13.640315+0000","last_fullsized":"2024-09-16T16:58:13.640315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.807469+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:01.807469+0000","last_peered":"2024-09-16T16:58:01.807469+0000","last_clean":"2024-09-16T16:58:01.807469+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:01.807469+0000","last_undegraded":"2024-09-16T16:58:01.807469+0000","last_fullsized":"2024-09-16T16:58:01.807469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.791422+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:01.791422+0000","last_peered":"2024-09-16T16:58:01.791422+0000","last_clean":"2024-09-16T16:58:01.791422+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:01.791422+0000","last_undegraded":"2024-09-16T16:58:01.791422+0000","last_fullsized":"2024-09-16T16:58:01.791422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'746","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.389599+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:13.389599+0000","last_peered":"2024-09-16T16:58:13.389599+0000","last_clean":"2024-09-16T16:58:13.389599+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:13.389599+0000","last_undegraded":"2024-09-16T16:58:13.389599+0000","last_fullsized":"2024-09-16T16:58:13.389599+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.866489+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:01.866489+0000","last_peered":"2024-09-16T16:58:01.866489+0000","last_clean":"2024-09-16T16:58:01.866489+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:01.866489+0000","last_undegraded":"2024-09-16T16:58:01.866489+0000","last_fullsized":"2024-09-16T16:58:01.866489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'799","reported_seq":865,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.836110+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:13.836110+0000","last_peered":"2024-09-16T16:58:13.836110+0000","last_clean":"2024-09-16T16:58:13.836110+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:13.836110+0000","last_undegraded":"2024-09-16T16:58:13.836110+0000","last_fullsized":"2024-09-16T16:58:13.836110+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.785515+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:01.785515+0000","last_peered":"2024-09-16T16:58:01.785515+0000","last_clean":"2024-09-16T16:58:01.785515+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:01.785515+0000","last_undegraded":"2024-09-16T16:58:01.785515+0000","last_fullsized":"2024-09-16T16:58:01.785515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'757","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.538228+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:13.538228+0000","last_peered":"2024-09-16T16:58:13.538228+0000","last_clean":"2024-09-16T16:58:13.538228+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:13.538228+0000","last_undegraded":"2024-09-16T16:58:13.538228+0000","last_fullsized":"2024-09-16T16:58:13.538228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.869999+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:01.869999+0000","last_peered":"2024-09-16T16:58:01.869999+0000","last_clean":"2024-09-16T16:58:01.869999+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:01.869999+0000","last_undegraded":"2024-09-16T16:58:01.869999+0000","last_fullsized":"2024-09-16T16:58:01.869999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'739","reported_seq":805,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.255775+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:13.255775+0000","last_peered":"2024-09-16T16:58:13.255775+0000","last_clean":"2024-09-16T16:58:13.255775+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:13.255775+0000","last_undegraded":"2024-09-16T16:58:13.255775+0000","last_fullsized":"2024-09-16T16:58:13.255775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.029355+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:02.029355+0000","last_peered":"2024-09-16T16:58:02.029355+0000","last_clean":"2024-09-16T16:58:02.029355+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:02.029355+0000","last_undegraded":"2024-09-16T16:58:02.029355+0000","last_fullsized":"2024-09-16T16:58:02.029355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'760","reported_seq":826,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.726625+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:13.726625+0000","last_peered":"2024-09-16T16:58:13.726625+0000","last_clean":"2024-09-16T16:58:13.726625+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:13.726625+0000","last_undegraded":"2024-09-16T16:58:13.726625+0000","last_fullsized":"2024-09-16T16:58:13.726625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.814449+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:01.814449+0000","last_peered":"2024-09-16T16:58:01.814449+0000","last_clean":"2024-09-16T16:58:01.814449+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:01.814449+0000","last_undegraded":"2024-09-16T16:58:01.814449+0000","last_fullsized":"2024-09-16T16:58:01.814449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'720","reported_seq":786,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.332604+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:13.332604+0000","last_peered":"2024-09-16T16:58:13.332604+0000","last_clean":"2024-09-16T16:58:13.332604+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:13.332604+0000","last_undegraded":"2024-09-16T16:58:13.332604+0000","last_fullsized":"2024-09-16T16:58:13.332604+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.027365+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:02.027365+0000","last_peered":"2024-09-16T16:58:02.027365+0000","last_clean":"2024-09-16T16:58:02.027365+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:02.027365+0000","last_undegraded":"2024-09-16T16:58:02.027365+0000","last_fullsized":"2024-09-16T16:58:02.027365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'708","reported_seq":774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.681177+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:13.681177+0000","last_peered":"2024-09-16T16:58:13.681177+0000","last_clean":"2024-09-16T16:58:13.681177+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:13.681177+0000","last_undegraded":"2024-09-16T16:58:13.681177+0000","last_fullsized":"2024-09-16T16:58:13.681177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.790754+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:01.790754+0000","last_peered":"2024-09-16T16:58:01.790754+0000","last_clean":"2024-09-16T16:58:01.790754+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:01.790754+0000","last_undegraded":"2024-09-16T16:58:01.790754+0000","last_fullsized":"2024-09-16T16:58:01.790754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":481427480,"num_objects":7347,"num_object_clones":0,"num_object_copies":22041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12111,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274776576,"internally_reserved":0,"allocated":2936717312,"data_stored":2936717312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12111,"ondisk_log_size":12111,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274514432,"internally_reserved":0,"allocated":2936979456,"data_stored":2936979456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662708,"kb_used_data":662708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635020,"statfs":{"total":53552873472,"available":52874260480,"internally_reserved":0,"allocated":678612992,"data_stored":678612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662040,"kb_used_data":662040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635688,"statfs":{"total":53552873472,"available":52874944512,"internally_reserved":0,"allocated":677928960,"data_stored":677928960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":777380,"kb_used_data":777380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51520348,"statfs":{"total":53552873472,"available":52756836352,"internally_reserved":0,"allocated":796037120,"data_stored":796037120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":785520,"kb_used_data":785520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51512208,"statfs":{"total":53552873472,"available":52748500992,"internally_reserved":0,"allocated":804372480,"data_stored":804372480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52759126016,"internally_reserved":0,"allocated":793747456,"data_stored":793747456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52759257088,"internally_reserved":0,"allocated":793616384,"data_stored":793616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52878217216,"internally_reserved":0,"allocated":674656256,"data_stored":674656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:39.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:39.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:39.767+0000 7f1ebdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:39.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:39.775+0000 7f1ebdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:42.248 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:42.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:42.403+0000 7f0e9b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:42.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:42.411+0000 7f0e9b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:42.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:42.537 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:42.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:42.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:42.693+0000 7fdac8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:42.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:42.710+0000 7fdac8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:43.004 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:43.019 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-09-16T16:58:41.907219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":482017867,"num_objects":7351,"num_object_clones":0,"num_object_copies":22053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12192,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12166,"ondisk_log_size":12166,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2887648,"kb_used_data":2887648,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206303264,"statfs":{"total":214211493888,"available":211254542336,"internally_reserved":0,"allocated":2956951552,"data_stored":2956951552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002619"},"pg_stats":[{"pgid":"6.f","version":"76'788","reported_seq":854,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.794456+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:13.794456+0000","last_peered":"2024-09-16T16:58:13.794456+0000","last_clean":"2024-09-16T16:58:13.794456+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:13.794456+0000","last_undegraded":"2024-09-16T16:58:13.794456+0000","last_fullsized":"2024-09-16T16:58:13.794456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'738","reported_seq":804,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.647282+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:13.647282+0000","last_peered":"2024-09-16T16:58:13.647282+0000","last_clean":"2024-09-16T16:58:13.647282+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:13.647282+0000","last_undegraded":"2024-09-16T16:58:13.647282+0000","last_fullsized":"2024-09-16T16:58:13.647282+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"76'750","reported_seq":817,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.609816+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:13.609816+0000","last_peered":"2024-09-16T16:58:13.609816+0000","last_clean":"2024-09-16T16:58:13.609816+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:13.609816+0000","last_undegraded":"2024-09-16T16:58:13.609816+0000","last_fullsized":"2024-09-16T16:58:13.609816+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867480,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":750,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"76'805","reported_seq":871,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.786931+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:13.786931+0000","last_peered":"2024-09-16T16:58:13.786931+0000","last_clean":"2024-09-16T16:58:13.786931+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:13.786931+0000","last_undegraded":"2024-09-16T16:58:13.786931+0000","last_fullsized":"2024-09-16T16:58:13.786931+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"76'782","reported_seq":848,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.574216+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:13.574216+0000","last_peered":"2024-09-16T16:58:13.574216+0000","last_clean":"2024-09-16T16:58:13.574216+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:13.574216+0000","last_undegraded":"2024-09-16T16:58:13.574216+0000","last_fullsized":"2024-09-16T16:58:13.574216+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":782,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'743","reported_seq":809,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.826680+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:13.826680+0000","last_peered":"2024-09-16T16:58:13.826680+0000","last_clean":"2024-09-16T16:58:13.826680+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:13.826680+0000","last_undegraded":"2024-09-16T16:58:13.826680+0000","last_fullsized":"2024-09-16T16:58:13.826680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'756","reported_seq":822,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.504554+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:13.504554+0000","last_peered":"2024-09-16T16:58:13.504554+0000","last_clean":"2024-09-16T16:58:13.504554+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:13.504554+0000","last_undegraded":"2024-09-16T16:58:13.504554+0000","last_fullsized":"2024-09-16T16:58:13.504554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"76'767","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.757574+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:13.757574+0000","last_peered":"2024-09-16T16:58:13.757574+0000","last_clean":"2024-09-16T16:58:13.757574+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:13.757574+0000","last_undegraded":"2024-09-16T16:58:13.757574+0000","last_fullsized":"2024-09-16T16:58:13.757574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'753","reported_seq":819,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.640315+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:13.640315+0000","last_peered":"2024-09-16T16:58:13.640315+0000","last_clean":"2024-09-16T16:58:13.640315+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:13.640315+0000","last_undegraded":"2024-09-16T16:58:13.640315+0000","last_fullsized":"2024-09-16T16:58:13.640315+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":268,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.807469+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:01.807469+0000","last_peered":"2024-09-16T16:58:01.807469+0000","last_clean":"2024-09-16T16:58:01.807469+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:01.807469+0000","last_undegraded":"2024-09-16T16:58:01.807469+0000","last_fullsized":"2024-09-16T16:58:01.807469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.791422+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:01.791422+0000","last_peered":"2024-09-16T16:58:01.791422+0000","last_clean":"2024-09-16T16:58:01.791422+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:01.791422+0000","last_undegraded":"2024-09-16T16:58:01.791422+0000","last_fullsized":"2024-09-16T16:58:01.791422+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"76'746","reported_seq":812,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.389599+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:13.389599+0000","last_peered":"2024-09-16T16:58:13.389599+0000","last_clean":"2024-09-16T16:58:13.389599+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:13.389599+0000","last_undegraded":"2024-09-16T16:58:13.389599+0000","last_fullsized":"2024-09-16T16:58:13.389599+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.866489+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:01.866489+0000","last_peered":"2024-09-16T16:58:01.866489+0000","last_clean":"2024-09-16T16:58:01.866489+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:01.866489+0000","last_undegraded":"2024-09-16T16:58:01.866489+0000","last_fullsized":"2024-09-16T16:58:01.866489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"76'799","reported_seq":865,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.836110+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:13.836110+0000","last_peered":"2024-09-16T16:58:13.836110+0000","last_clean":"2024-09-16T16:58:13.836110+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:13.836110+0000","last_undegraded":"2024-09-16T16:58:13.836110+0000","last_fullsized":"2024-09-16T16:58:13.836110+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.785515+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:01.785515+0000","last_peered":"2024-09-16T16:58:01.785515+0000","last_clean":"2024-09-16T16:58:01.785515+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:01.785515+0000","last_undegraded":"2024-09-16T16:58:01.785515+0000","last_fullsized":"2024-09-16T16:58:01.785515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"76'757","reported_seq":823,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.538228+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:13.538228+0000","last_peered":"2024-09-16T16:58:13.538228+0000","last_clean":"2024-09-16T16:58:13.538228+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:13.538228+0000","last_undegraded":"2024-09-16T16:58:13.538228+0000","last_fullsized":"2024-09-16T16:58:13.538228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":757,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.869999+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:01.869999+0000","last_peered":"2024-09-16T16:58:01.869999+0000","last_clean":"2024-09-16T16:58:01.869999+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:01.869999+0000","last_undegraded":"2024-09-16T16:58:01.869999+0000","last_fullsized":"2024-09-16T16:58:01.869999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'739","reported_seq":805,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.255775+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:13.255775+0000","last_peered":"2024-09-16T16:58:13.255775+0000","last_clean":"2024-09-16T16:58:13.255775+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:13.255775+0000","last_undegraded":"2024-09-16T16:58:13.255775+0000","last_fullsized":"2024-09-16T16:58:13.255775+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29425664,"num_objects":449,"num_object_clones":0,"num_object_copies":1347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.029355+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:02.029355+0000","last_peered":"2024-09-16T16:58:02.029355+0000","last_clean":"2024-09-16T16:58:02.029355+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:02.029355+0000","last_undegraded":"2024-09-16T16:58:02.029355+0000","last_fullsized":"2024-09-16T16:58:02.029355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"76'760","reported_seq":826,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.726625+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:13.726625+0000","last_peered":"2024-09-16T16:58:13.726625+0000","last_clean":"2024-09-16T16:58:13.726625+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:13.726625+0000","last_undegraded":"2024-09-16T16:58:13.726625+0000","last_fullsized":"2024-09-16T16:58:13.726625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.814449+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:01.814449+0000","last_peered":"2024-09-16T16:58:01.814449+0000","last_clean":"2024-09-16T16:58:01.814449+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:01.814449+0000","last_undegraded":"2024-09-16T16:58:01.814449+0000","last_fullsized":"2024-09-16T16:58:01.814449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"76'720","reported_seq":786,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.332604+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:13.332604+0000","last_peered":"2024-09-16T16:58:13.332604+0000","last_clean":"2024-09-16T16:58:13.332604+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:13.332604+0000","last_undegraded":"2024-09-16T16:58:13.332604+0000","last_fullsized":"2024-09-16T16:58:13.332604+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:02.027365+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:02.027365+0000","last_peered":"2024-09-16T16:58:02.027365+0000","last_clean":"2024-09-16T16:58:02.027365+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:02.027365+0000","last_undegraded":"2024-09-16T16:58:02.027365+0000","last_fullsized":"2024-09-16T16:58:02.027365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"76'708","reported_seq":774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:13.681177+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:13.681177+0000","last_peered":"2024-09-16T16:58:13.681177+0000","last_clean":"2024-09-16T16:58:13.681177+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:13.681177+0000","last_undegraded":"2024-09-16T16:58:13.681177+0000","last_fullsized":"2024-09-16T16:58:13.681177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T16:58:01.790754+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:01.790754+0000","last_peered":"2024-09-16T16:58:01.790754+0000","last_clean":"2024-09-16T16:58:01.790754+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:01.790754+0000","last_undegraded":"2024-09-16T16:58:01.790754+0000","last_fullsized":"2024-09-16T16:58:01.790754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":481427480,"num_objects":7347,"num_object_clones":0,"num_object_copies":22041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12111,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274776576,"internally_reserved":0,"allocated":2936717312,"data_stored":2936717312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12111,"ondisk_log_size":12111,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211274514432,"internally_reserved":0,"allocated":2936979456,"data_stored":2936979456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662708,"kb_used_data":662708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635020,"statfs":{"total":53552873472,"available":52874260480,"internally_reserved":0,"allocated":678612992,"data_stored":678612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":662040,"kb_used_data":662040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51635688,"statfs":{"total":53552873472,"available":52874944512,"internally_reserved":0,"allocated":677928960,"data_stored":677928960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":777380,"kb_used_data":777380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51520348,"statfs":{"total":53552873472,"available":52756836352,"internally_reserved":0,"allocated":796037120,"data_stored":796037120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706353,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":785520,"kb_used_data":785520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51512208,"statfs":{"total":53552873472,"available":52748500992,"internally_reserved":0,"allocated":804372480,"data_stored":804372480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52759126016,"internally_reserved":0,"allocated":793747456,"data_stored":793747456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52878086144,"internally_reserved":0,"allocated":674787328,"data_stored":674787328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":52759257088,"internally_reserved":0,"allocated":793616384,"data_stored":793616384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":52761571328,"internally_reserved":0,"allocated":791302144,"data_stored":791302144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":52875730944,"internally_reserved":0,"allocated":677142528,"data_stored":677142528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":52878217216,"internally_reserved":0,"allocated":674656256,"data_stored":674656256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:44.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:44.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:44.937+0000 7f67fe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:44.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:44.943+0000 7f67fe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:47.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:47.689+0000 7f3544cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:47.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:47.696+0000 7f3544cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:48.021 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:48.021 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:48.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:48.204+0000 7fdc936d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:48.217+0000 7fdc936d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:48.595 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:48.617 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-09-16T16:58:47.908578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":247464523,"num_objects":3772,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15771,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15745,"ondisk_log_size":15745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1520904,"kb_used_data":1520904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207670008,"statfs":{"total":214211493888,"available":212654088192,"internally_reserved":0,"allocated":1557405696,"data_stored":1557405696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-234553344,"num_objects":-3579,"num_object_clones":0,"num_object_copies":-10737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3579,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"6.f","version":"80'1030","reported_seq":1108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.711651+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:43.711651+0000","last_peered":"2024-09-16T16:58:43.711651+0000","last_clean":"2024-09-16T16:58:43.711651+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:43.711651+0000","last_undegraded":"2024-09-16T16:58:43.711651+0000","last_fullsized":"2024-09-16T16:58:43.711651+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'964","reported_seq":1042,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.397756+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:43.397756+0000","last_peered":"2024-09-16T16:58:43.397756+0000","last_clean":"2024-09-16T16:58:43.397756+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:43.397756+0000","last_undegraded":"2024-09-16T16:58:43.397756+0000","last_fullsized":"2024-09-16T16:58:43.397756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'988","reported_seq":1067,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.495926+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:43.495926+0000","last_peered":"2024-09-16T16:58:43.495926+0000","last_clean":"2024-09-16T16:58:43.495926+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:43.495926+0000","last_undegraded":"2024-09-16T16:58:43.495926+0000","last_fullsized":"2024-09-16T16:58:43.495926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269912,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":988,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1033","reported_seq":1111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.689245+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:43.689245+0000","last_peered":"2024-09-16T16:58:43.689245+0000","last_clean":"2024-09-16T16:58:43.689245+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:43.689245+0000","last_undegraded":"2024-09-16T16:58:43.689245+0000","last_fullsized":"2024-09-16T16:58:43.689245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1011","reported_seq":1089,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.601079+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:43.601079+0000","last_peered":"2024-09-16T16:58:43.601079+0000","last_clean":"2024-09-16T16:58:43.601079+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:43.601079+0000","last_undegraded":"2024-09-16T16:58:43.601079+0000","last_fullsized":"2024-09-16T16:58:43.601079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'978","reported_seq":1056,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.893828+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:43.893828+0000","last_peered":"2024-09-16T16:58:43.893828+0000","last_clean":"2024-09-16T16:58:43.893828+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:43.893828+0000","last_undegraded":"2024-09-16T16:58:43.893828+0000","last_fullsized":"2024-09-16T16:58:43.893828+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.469394+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:43.469394+0000","last_peered":"2024-09-16T16:58:43.469394+0000","last_clean":"2024-09-16T16:58:43.469394+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:43.469394+0000","last_undegraded":"2024-09-16T16:58:43.469394+0000","last_fullsized":"2024-09-16T16:58:43.469394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'993","reported_seq":1071,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.577786+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:43.577786+0000","last_peered":"2024-09-16T16:58:43.577786+0000","last_clean":"2024-09-16T16:58:43.577786+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:43.577786+0000","last_undegraded":"2024-09-16T16:58:43.577786+0000","last_fullsized":"2024-09-16T16:58:43.577786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'955","reported_seq":1033,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.630708+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:43.630708+0000","last_peered":"2024-09-16T16:58:43.630708+0000","last_clean":"2024-09-16T16:58:43.630708+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:43.630708+0000","last_undegraded":"2024-09-16T16:58:43.630708+0000","last_fullsized":"2024-09-16T16:58:43.630708+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.737431+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:43.737431+0000","last_peered":"2024-09-16T16:58:43.737431+0000","last_clean":"2024-09-16T16:58:43.737431+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:43.737431+0000","last_undegraded":"2024-09-16T16:58:43.737431+0000","last_fullsized":"2024-09-16T16:58:43.737431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1041","reported_seq":1119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.626591+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:43.626591+0000","last_peered":"2024-09-16T16:58:43.626591+0000","last_clean":"2024-09-16T16:58:43.626591+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:43.626591+0000","last_undegraded":"2024-09-16T16:58:43.626591+0000","last_fullsized":"2024-09-16T16:58:43.626591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'982","reported_seq":1060,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.839356+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:43.839356+0000","last_peered":"2024-09-16T16:58:43.839356+0000","last_clean":"2024-09-16T16:58:43.839356+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:43.839356+0000","last_undegraded":"2024-09-16T16:58:43.839356+0000","last_fullsized":"2024-09-16T16:58:43.839356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'961","reported_seq":1039,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.810258+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:43.810258+0000","last_peered":"2024-09-16T16:58:43.810258+0000","last_clean":"2024-09-16T16:58:43.810258+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:43.810258+0000","last_undegraded":"2024-09-16T16:58:43.810258+0000","last_fullsized":"2024-09-16T16:58:43.810258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'949","reported_seq":1027,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.827522+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:43.827522+0000","last_peered":"2024-09-16T16:58:43.827522+0000","last_clean":"2024-09-16T16:58:43.827522+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:43.827522+0000","last_undegraded":"2024-09-16T16:58:43.827522+0000","last_fullsized":"2024-09-16T16:58:43.827522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'945","reported_seq":1023,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.399345+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:43.399345+0000","last_peered":"2024-09-16T16:58:43.399345+0000","last_clean":"2024-09-16T16:58:43.399345+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:43.399345+0000","last_undegraded":"2024-09-16T16:58:43.399345+0000","last_fullsized":"2024-09-16T16:58:43.399345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'900","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.706579+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:43.706579+0000","last_peered":"2024-09-16T16:58:43.706579+0000","last_clean":"2024-09-16T16:58:43.706579+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:43.706579+0000","last_undegraded":"2024-09-16T16:58:43.706579+0000","last_fullsized":"2024-09-16T16:58:43.706579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":246874136,"num_objects":3768,"num_object_clones":0,"num_object_copies":11304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15690,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681809920,"internally_reserved":0,"allocated":1529683968,"data_stored":1529683968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15690,"ondisk_log_size":15690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681547776,"internally_reserved":0,"allocated":1529946112,"data_stored":1529946112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":348568,"kb_used_data":348568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51949160,"statfs":{"total":53552873472,"available":53195939840,"internally_reserved":0,"allocated":356933632,"data_stored":356933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":353184,"kb_used_data":353184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51944544,"statfs":{"total":53552873472,"available":53191213056,"internally_reserved":0,"allocated":361660416,"data_stored":361660416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":405688,"kb_used_data":405688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51892040,"statfs":{"total":53552873472,"available":53137448960,"internally_reserved":0,"allocated":415424512,"data_stored":415424512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":413464,"kb_used_data":413464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51884264,"statfs":{"total":53552873472,"available":53129486336,"internally_reserved":0,"allocated":423387136,"data_stored":423387136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139542016,"internally_reserved":0,"allocated":413331456,"data_stored":413331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53140619264,"internally_reserved":0,"allocated":412254208,"data_stored":412254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53139673088,"internally_reserved":0,"allocated":413200384,"data_stored":413200384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53140750336,"internally_reserved":0,"allocated":412123136,"data_stored":412123136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:50.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:50.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:50.444+0000 7fd5eb6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:50.452+0000 7fd5eb6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:53.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:53.072+0000 7fe8bc951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:53.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:53.078+0000 7fe8bc951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:53.619 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:53.619 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:53.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:53.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:53.755+0000 7f8e91191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:53.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:53.765+0000 7f8e91191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:54.008 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:54.009 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:54.027 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-09-16T16:58:53.909848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":247464523,"num_objects":3772,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15771,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15745,"ondisk_log_size":15745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1520904,"kb_used_data":1520904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207670008,"statfs":{"total":214211493888,"available":212654088192,"internally_reserved":0,"allocated":1557405696,"data_stored":1557405696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-234553344,"num_objects":-3579,"num_object_clones":0,"num_object_copies":-10737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3579,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002628"},"pg_stats":[{"pgid":"6.f","version":"80'1030","reported_seq":1108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.711651+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:43.711651+0000","last_peered":"2024-09-16T16:58:43.711651+0000","last_clean":"2024-09-16T16:58:43.711651+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:43.711651+0000","last_undegraded":"2024-09-16T16:58:43.711651+0000","last_fullsized":"2024-09-16T16:58:43.711651+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'964","reported_seq":1042,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.397756+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:43.397756+0000","last_peered":"2024-09-16T16:58:43.397756+0000","last_clean":"2024-09-16T16:58:43.397756+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:43.397756+0000","last_undegraded":"2024-09-16T16:58:43.397756+0000","last_fullsized":"2024-09-16T16:58:43.397756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'988","reported_seq":1067,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.495926+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:43.495926+0000","last_peered":"2024-09-16T16:58:43.495926+0000","last_clean":"2024-09-16T16:58:43.495926+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:43.495926+0000","last_undegraded":"2024-09-16T16:58:43.495926+0000","last_fullsized":"2024-09-16T16:58:43.495926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269912,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":988,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1033","reported_seq":1111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.689245+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:43.689245+0000","last_peered":"2024-09-16T16:58:43.689245+0000","last_clean":"2024-09-16T16:58:43.689245+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:43.689245+0000","last_undegraded":"2024-09-16T16:58:43.689245+0000","last_fullsized":"2024-09-16T16:58:43.689245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1011","reported_seq":1089,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.601079+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:43.601079+0000","last_peered":"2024-09-16T16:58:43.601079+0000","last_clean":"2024-09-16T16:58:43.601079+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:43.601079+0000","last_undegraded":"2024-09-16T16:58:43.601079+0000","last_fullsized":"2024-09-16T16:58:43.601079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'978","reported_seq":1056,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.893828+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:43.893828+0000","last_peered":"2024-09-16T16:58:43.893828+0000","last_clean":"2024-09-16T16:58:43.893828+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:43.893828+0000","last_undegraded":"2024-09-16T16:58:43.893828+0000","last_fullsized":"2024-09-16T16:58:43.893828+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.469394+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:43.469394+0000","last_peered":"2024-09-16T16:58:43.469394+0000","last_clean":"2024-09-16T16:58:43.469394+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:43.469394+0000","last_undegraded":"2024-09-16T16:58:43.469394+0000","last_fullsized":"2024-09-16T16:58:43.469394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'993","reported_seq":1071,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.577786+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:43.577786+0000","last_peered":"2024-09-16T16:58:43.577786+0000","last_clean":"2024-09-16T16:58:43.577786+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:43.577786+0000","last_undegraded":"2024-09-16T16:58:43.577786+0000","last_fullsized":"2024-09-16T16:58:43.577786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'955","reported_seq":1033,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.630708+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:43.630708+0000","last_peered":"2024-09-16T16:58:43.630708+0000","last_clean":"2024-09-16T16:58:43.630708+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:43.630708+0000","last_undegraded":"2024-09-16T16:58:43.630708+0000","last_fullsized":"2024-09-16T16:58:43.630708+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.737431+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:43.737431+0000","last_peered":"2024-09-16T16:58:43.737431+0000","last_clean":"2024-09-16T16:58:43.737431+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:43.737431+0000","last_undegraded":"2024-09-16T16:58:43.737431+0000","last_fullsized":"2024-09-16T16:58:43.737431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1041","reported_seq":1119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.626591+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:43.626591+0000","last_peered":"2024-09-16T16:58:43.626591+0000","last_clean":"2024-09-16T16:58:43.626591+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:43.626591+0000","last_undegraded":"2024-09-16T16:58:43.626591+0000","last_fullsized":"2024-09-16T16:58:43.626591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'982","reported_seq":1060,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.839356+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:43.839356+0000","last_peered":"2024-09-16T16:58:43.839356+0000","last_clean":"2024-09-16T16:58:43.839356+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:43.839356+0000","last_undegraded":"2024-09-16T16:58:43.839356+0000","last_fullsized":"2024-09-16T16:58:43.839356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'961","reported_seq":1039,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.810258+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:43.810258+0000","last_peered":"2024-09-16T16:58:43.810258+0000","last_clean":"2024-09-16T16:58:43.810258+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:43.810258+0000","last_undegraded":"2024-09-16T16:58:43.810258+0000","last_fullsized":"2024-09-16T16:58:43.810258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'949","reported_seq":1027,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.827522+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:43.827522+0000","last_peered":"2024-09-16T16:58:43.827522+0000","last_clean":"2024-09-16T16:58:43.827522+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:43.827522+0000","last_undegraded":"2024-09-16T16:58:43.827522+0000","last_fullsized":"2024-09-16T16:58:43.827522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'945","reported_seq":1023,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.399345+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:43.399345+0000","last_peered":"2024-09-16T16:58:43.399345+0000","last_clean":"2024-09-16T16:58:43.399345+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:43.399345+0000","last_undegraded":"2024-09-16T16:58:43.399345+0000","last_fullsized":"2024-09-16T16:58:43.399345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'900","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.706579+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:43.706579+0000","last_peered":"2024-09-16T16:58:43.706579+0000","last_clean":"2024-09-16T16:58:43.706579+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:43.706579+0000","last_undegraded":"2024-09-16T16:58:43.706579+0000","last_fullsized":"2024-09-16T16:58:43.706579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":246874136,"num_objects":3768,"num_object_clones":0,"num_object_copies":11304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15690,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681809920,"internally_reserved":0,"allocated":1529683968,"data_stored":1529683968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15690,"ondisk_log_size":15690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681547776,"internally_reserved":0,"allocated":1529946112,"data_stored":1529946112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":348568,"kb_used_data":348568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51949160,"statfs":{"total":53552873472,"available":53195939840,"internally_reserved":0,"allocated":356933632,"data_stored":356933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":353184,"kb_used_data":353184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51944544,"statfs":{"total":53552873472,"available":53191213056,"internally_reserved":0,"allocated":361660416,"data_stored":361660416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":405688,"kb_used_data":405688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51892040,"statfs":{"total":53552873472,"available":53137448960,"internally_reserved":0,"allocated":415424512,"data_stored":415424512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":413464,"kb_used_data":413464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51884264,"statfs":{"total":53552873472,"available":53129486336,"internally_reserved":0,"allocated":423387136,"data_stored":423387136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139542016,"internally_reserved":0,"allocated":413331456,"data_stored":413331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53140619264,"internally_reserved":0,"allocated":412254208,"data_stored":412254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53139673088,"internally_reserved":0,"allocated":413200384,"data_stored":413200384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53140750336,"internally_reserved":0,"allocated":412123136,"data_stored":412123136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:55.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:55.611+0000 7f0b4dcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:55.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:55.620+0000 7f0b4dcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:58.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:58.163+0000 7f674bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:58.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:58.171+0000 7f674bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:59.029 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:59.029 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:59.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:59.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:59.168+0000 7f5f5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:59.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:58:59.179+0000 7f5f5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:59.486 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:58:59.487 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:58:59.512 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-09-16T16:58:57.910618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":247464523,"num_objects":3772,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15771,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15745,"ondisk_log_size":15745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1520904,"kb_used_data":1520904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207670008,"statfs":{"total":214211493888,"available":212654088192,"internally_reserved":0,"allocated":1557405696,"data_stored":1557405696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002536"},"pg_stats":[{"pgid":"6.f","version":"80'1030","reported_seq":1108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.711651+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:43.711651+0000","last_peered":"2024-09-16T16:58:43.711651+0000","last_clean":"2024-09-16T16:58:43.711651+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:43.711651+0000","last_undegraded":"2024-09-16T16:58:43.711651+0000","last_fullsized":"2024-09-16T16:58:43.711651+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'964","reported_seq":1042,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.397756+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:43.397756+0000","last_peered":"2024-09-16T16:58:43.397756+0000","last_clean":"2024-09-16T16:58:43.397756+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:43.397756+0000","last_undegraded":"2024-09-16T16:58:43.397756+0000","last_fullsized":"2024-09-16T16:58:43.397756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'988","reported_seq":1067,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.495926+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:43.495926+0000","last_peered":"2024-09-16T16:58:43.495926+0000","last_clean":"2024-09-16T16:58:43.495926+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:43.495926+0000","last_undegraded":"2024-09-16T16:58:43.495926+0000","last_fullsized":"2024-09-16T16:58:43.495926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269912,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":988,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1033","reported_seq":1111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.689245+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:43.689245+0000","last_peered":"2024-09-16T16:58:43.689245+0000","last_clean":"2024-09-16T16:58:43.689245+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:43.689245+0000","last_undegraded":"2024-09-16T16:58:43.689245+0000","last_fullsized":"2024-09-16T16:58:43.689245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1011","reported_seq":1089,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.601079+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:43.601079+0000","last_peered":"2024-09-16T16:58:43.601079+0000","last_clean":"2024-09-16T16:58:43.601079+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:43.601079+0000","last_undegraded":"2024-09-16T16:58:43.601079+0000","last_fullsized":"2024-09-16T16:58:43.601079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'978","reported_seq":1056,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.893828+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:43.893828+0000","last_peered":"2024-09-16T16:58:43.893828+0000","last_clean":"2024-09-16T16:58:43.893828+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:43.893828+0000","last_undegraded":"2024-09-16T16:58:43.893828+0000","last_fullsized":"2024-09-16T16:58:43.893828+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.469394+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:43.469394+0000","last_peered":"2024-09-16T16:58:43.469394+0000","last_clean":"2024-09-16T16:58:43.469394+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:43.469394+0000","last_undegraded":"2024-09-16T16:58:43.469394+0000","last_fullsized":"2024-09-16T16:58:43.469394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'993","reported_seq":1071,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.577786+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:43.577786+0000","last_peered":"2024-09-16T16:58:43.577786+0000","last_clean":"2024-09-16T16:58:43.577786+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:43.577786+0000","last_undegraded":"2024-09-16T16:58:43.577786+0000","last_fullsized":"2024-09-16T16:58:43.577786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'955","reported_seq":1033,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.630708+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:43.630708+0000","last_peered":"2024-09-16T16:58:43.630708+0000","last_clean":"2024-09-16T16:58:43.630708+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:43.630708+0000","last_undegraded":"2024-09-16T16:58:43.630708+0000","last_fullsized":"2024-09-16T16:58:43.630708+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.737431+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:43.737431+0000","last_peered":"2024-09-16T16:58:43.737431+0000","last_clean":"2024-09-16T16:58:43.737431+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:43.737431+0000","last_undegraded":"2024-09-16T16:58:43.737431+0000","last_fullsized":"2024-09-16T16:58:43.737431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1041","reported_seq":1119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.626591+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:43.626591+0000","last_peered":"2024-09-16T16:58:43.626591+0000","last_clean":"2024-09-16T16:58:43.626591+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:43.626591+0000","last_undegraded":"2024-09-16T16:58:43.626591+0000","last_fullsized":"2024-09-16T16:58:43.626591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'982","reported_seq":1060,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.839356+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:43.839356+0000","last_peered":"2024-09-16T16:58:43.839356+0000","last_clean":"2024-09-16T16:58:43.839356+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:43.839356+0000","last_undegraded":"2024-09-16T16:58:43.839356+0000","last_fullsized":"2024-09-16T16:58:43.839356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'961","reported_seq":1039,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.810258+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:43.810258+0000","last_peered":"2024-09-16T16:58:43.810258+0000","last_clean":"2024-09-16T16:58:43.810258+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:43.810258+0000","last_undegraded":"2024-09-16T16:58:43.810258+0000","last_fullsized":"2024-09-16T16:58:43.810258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'949","reported_seq":1027,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.827522+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:43.827522+0000","last_peered":"2024-09-16T16:58:43.827522+0000","last_clean":"2024-09-16T16:58:43.827522+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:43.827522+0000","last_undegraded":"2024-09-16T16:58:43.827522+0000","last_fullsized":"2024-09-16T16:58:43.827522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'945","reported_seq":1023,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.399345+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:43.399345+0000","last_peered":"2024-09-16T16:58:43.399345+0000","last_clean":"2024-09-16T16:58:43.399345+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:43.399345+0000","last_undegraded":"2024-09-16T16:58:43.399345+0000","last_fullsized":"2024-09-16T16:58:43.399345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'900","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.706579+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:43.706579+0000","last_peered":"2024-09-16T16:58:43.706579+0000","last_clean":"2024-09-16T16:58:43.706579+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:43.706579+0000","last_undegraded":"2024-09-16T16:58:43.706579+0000","last_fullsized":"2024-09-16T16:58:43.706579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":246874136,"num_objects":3768,"num_object_clones":0,"num_object_copies":11304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15690,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681809920,"internally_reserved":0,"allocated":1529683968,"data_stored":1529683968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15690,"ondisk_log_size":15690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681547776,"internally_reserved":0,"allocated":1529946112,"data_stored":1529946112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":348568,"kb_used_data":348568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51949160,"statfs":{"total":53552873472,"available":53195939840,"internally_reserved":0,"allocated":356933632,"data_stored":356933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":353184,"kb_used_data":353184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51944544,"statfs":{"total":53552873472,"available":53191213056,"internally_reserved":0,"allocated":361660416,"data_stored":361660416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":405688,"kb_used_data":405688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51892040,"statfs":{"total":53552873472,"available":53137448960,"internally_reserved":0,"allocated":415424512,"data_stored":415424512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":413464,"kb_used_data":413464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51884264,"statfs":{"total":53552873472,"available":53129486336,"internally_reserved":0,"allocated":423387136,"data_stored":423387136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139542016,"internally_reserved":0,"allocated":413331456,"data_stored":413331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53140619264,"internally_reserved":0,"allocated":412254208,"data_stored":412254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53139673088,"internally_reserved":0,"allocated":413200384,"data_stored":413200384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53140750336,"internally_reserved":0,"allocated":412123136,"data_stored":412123136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:00.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:00.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:00.609+0000 7fe947191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:00.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:00.616+0000 7fe947191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:02.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:03.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:03.086+0000 7f5e81991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:03.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:03.093+0000 7f5e81991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.514 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:04.514 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:04.514 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:04.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:04.658+0000 7f83a3897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:04.668+0000 7f83a3897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:59:04.991 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:59:05.012 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2024-09-16T16:59:03.911906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":247464523,"num_objects":3772,"num_object_clones":0,"num_object_copies":11316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15771,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15745,"ondisk_log_size":15745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1520904,"kb_used_data":1520904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207670008,"statfs":{"total":214211493888,"available":212654088192,"internally_reserved":0,"allocated":1557405696,"data_stored":1557405696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002464"},"pg_stats":[{"pgid":"6.f","version":"80'1030","reported_seq":1108,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.711651+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:58:43.711651+0000","last_peered":"2024-09-16T16:58:43.711651+0000","last_clean":"2024-09-16T16:58:43.711651+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:58:43.711651+0000","last_undegraded":"2024-09-16T16:58:43.711651+0000","last_fullsized":"2024-09-16T16:58:43.711651+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'964","reported_seq":1042,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.397756+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:58:43.397756+0000","last_peered":"2024-09-16T16:58:43.397756+0000","last_clean":"2024-09-16T16:58:43.397756+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:58:43.397756+0000","last_undegraded":"2024-09-16T16:58:43.397756+0000","last_fullsized":"2024-09-16T16:58:43.397756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'988","reported_seq":1067,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.495926+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:58:43.495926+0000","last_peered":"2024-09-16T16:58:43.495926+0000","last_clean":"2024-09-16T16:58:43.495926+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:58:43.495926+0000","last_undegraded":"2024-09-16T16:58:43.495926+0000","last_fullsized":"2024-09-16T16:58:43.495926+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269912,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":988,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1033","reported_seq":1111,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.689245+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:58:43.689245+0000","last_peered":"2024-09-16T16:58:43.689245+0000","last_clean":"2024-09-16T16:58:43.689245+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:58:43.689245+0000","last_undegraded":"2024-09-16T16:58:43.689245+0000","last_fullsized":"2024-09-16T16:58:43.689245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1011","reported_seq":1089,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.601079+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:58:43.601079+0000","last_peered":"2024-09-16T16:58:43.601079+0000","last_clean":"2024-09-16T16:58:43.601079+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:58:43.601079+0000","last_undegraded":"2024-09-16T16:58:43.601079+0000","last_fullsized":"2024-09-16T16:58:43.601079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1011,"log_dups_size":0,"ondisk_log_size":1011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056320,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1011,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'978","reported_seq":1056,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.893828+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:58:43.893828+0000","last_peered":"2024-09-16T16:58:43.893828+0000","last_clean":"2024-09-16T16:58:43.893828+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:58:43.893828+0000","last_undegraded":"2024-09-16T16:58:43.893828+0000","last_fullsized":"2024-09-16T16:58:43.893828+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.469394+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:58:43.469394+0000","last_peered":"2024-09-16T16:58:43.469394+0000","last_clean":"2024-09-16T16:58:43.469394+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:58:43.469394+0000","last_undegraded":"2024-09-16T16:58:43.469394+0000","last_fullsized":"2024-09-16T16:58:43.469394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'993","reported_seq":1071,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.577786+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:58:43.577786+0000","last_peered":"2024-09-16T16:58:43.577786+0000","last_clean":"2024-09-16T16:58:43.577786+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:58:43.577786+0000","last_undegraded":"2024-09-16T16:58:43.577786+0000","last_fullsized":"2024-09-16T16:58:43.577786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'955","reported_seq":1033,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.630708+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:58:43.630708+0000","last_peered":"2024-09-16T16:58:43.630708+0000","last_clean":"2024-09-16T16:58:43.630708+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:58:43.630708+0000","last_undegraded":"2024-09-16T16:58:43.630708+0000","last_fullsized":"2024-09-16T16:58:43.630708+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":955,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'980","reported_seq":1058,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.737431+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:58:43.737431+0000","last_peered":"2024-09-16T16:58:43.737431+0000","last_clean":"2024-09-16T16:58:43.737431+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:58:43.737431+0000","last_undegraded":"2024-09-16T16:58:43.737431+0000","last_fullsized":"2024-09-16T16:58:43.737431+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1041","reported_seq":1119,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.626591+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:58:43.626591+0000","last_peered":"2024-09-16T16:58:43.626591+0000","last_clean":"2024-09-16T16:58:43.626591+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:58:43.626591+0000","last_undegraded":"2024-09-16T16:58:43.626591+0000","last_fullsized":"2024-09-16T16:58:43.626591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'982","reported_seq":1060,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.839356+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:58:43.839356+0000","last_peered":"2024-09-16T16:58:43.839356+0000","last_clean":"2024-09-16T16:58:43.839356+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:58:43.839356+0000","last_undegraded":"2024-09-16T16:58:43.839356+0000","last_fullsized":"2024-09-16T16:58:43.839356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'961","reported_seq":1039,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.810258+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:58:43.810258+0000","last_peered":"2024-09-16T16:58:43.810258+0000","last_clean":"2024-09-16T16:58:43.810258+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:58:43.810258+0000","last_undegraded":"2024-09-16T16:58:43.810258+0000","last_fullsized":"2024-09-16T16:58:43.810258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'949","reported_seq":1027,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.827522+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:58:43.827522+0000","last_peered":"2024-09-16T16:58:43.827522+0000","last_clean":"2024-09-16T16:58:43.827522+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:58:43.827522+0000","last_undegraded":"2024-09-16T16:58:43.827522+0000","last_fullsized":"2024-09-16T16:58:43.827522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":949,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'945","reported_seq":1023,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.399345+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:58:43.399345+0000","last_peered":"2024-09-16T16:58:43.399345+0000","last_clean":"2024-09-16T16:58:43.399345+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:58:43.399345+0000","last_undegraded":"2024-09-16T16:58:43.399345+0000","last_fullsized":"2024-09-16T16:58:43.399345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15532032,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'900","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:43.706579+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:58:43.706579+0000","last_peered":"2024-09-16T16:58:43.706579+0000","last_clean":"2024-09-16T16:58:43.706579+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:58:43.706579+0000","last_undegraded":"2024-09-16T16:58:43.706579+0000","last_fullsized":"2024-09-16T16:58:43.706579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":246874136,"num_objects":3768,"num_object_clones":0,"num_object_copies":11304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15690,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681809920,"internally_reserved":0,"allocated":1529683968,"data_stored":1529683968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15690,"ondisk_log_size":15690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212681547776,"internally_reserved":0,"allocated":1529946112,"data_stored":1529946112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":348568,"kb_used_data":348568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51949160,"statfs":{"total":53552873472,"available":53195939840,"internally_reserved":0,"allocated":356933632,"data_stored":356933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":353184,"kb_used_data":353184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51944544,"statfs":{"total":53552873472,"available":53191213056,"internally_reserved":0,"allocated":361660416,"data_stored":361660416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":405688,"kb_used_data":405688,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51892040,"statfs":{"total":53552873472,"available":53137448960,"internally_reserved":0,"allocated":415424512,"data_stored":415424512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":413464,"kb_used_data":413464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51884264,"statfs":{"total":53552873472,"available":53129486336,"internally_reserved":0,"allocated":423387136,"data_stored":423387136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53139542016,"internally_reserved":0,"allocated":413331456,"data_stored":413331456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53140619264,"internally_reserved":0,"allocated":412254208,"data_stored":412254208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53139673088,"internally_reserved":0,"allocated":413200384,"data_stored":413200384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53140750336,"internally_reserved":0,"allocated":412123136,"data_stored":412123136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53201379328,"internally_reserved":0,"allocated":351494144,"data_stored":351494144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53200007168,"internally_reserved":0,"allocated":352866304,"data_stored":352866304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:05.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:05.500+0000 7fc60b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:05.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:05.510+0000 7fc60b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:07.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:08.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:08.034+0000 7f0bdc06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:08.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:08.042+0000 7f0bdc06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:10.015 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:10.015 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:10.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:10.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.160+0000 7f3bcd4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.173+0000 7f3bcd4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:10.345 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:10.346 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:10.350 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:10.350 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:10.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:10.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.491+0000 7f92d5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.504+0000 7f92d5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.555+0000 7fd050474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.570+0000 7fd050474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:10.672 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:10.673 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:10.676 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:10.676 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:10.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.840+0000 7fb78d708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:10.851+0000 7fb78d708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:10.917 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:10.917 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:10.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:11.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:11.113+0000 7f784a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:11.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:11.128+0000 7f784a951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:11.153 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:11.154 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:11.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:11.160 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:12.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:12.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:12.975+0000 7f9f98111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:12.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:12.983+0000 7f9f98111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:15.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:15.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:15.564+0000 7f6609711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:15.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:15.575+0000 7f6609711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.160 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:16.161 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:16.161 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:16.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.307+0000 7fdff1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.319+0000 7fdff1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:16.399 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:16.400 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:16.400 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:16.403 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:16.403 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:16.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:16.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.572+0000 7ff92fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.587+0000 7ff92fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.686 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:16.686 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:16.686 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:16.687 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:16.690 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:16.690 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:16.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:16.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.831+0000 7f1896093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:16.843+0000 7f1896093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:16.898 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:16.899 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:16.899 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:16.899 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:16.899 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:16.902 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:16.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:16.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:17.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:17.063+0000 7ffa93f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:17.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:17.079+0000 7ffa93f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:17.125 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:17.126 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:17.129 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:17.130 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:17.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:18.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:18.151+0000 7fdaa1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:18.159+0000 7fdaa1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:20.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:20.832+0000 7fef49d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:20.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:20.839+0000 7fef49d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:22.130 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:22.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:59:22.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:22.305+0000 7fccbf493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:22.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:22.321+0000 7fccbf493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:22.582 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 9728 objects 2024-09-16T16:59:22.582 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :86.6713 2024-09-16T16:59:22.783 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:59:22.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:59:22.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:22.910+0000 7f449debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:22.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:22.920+0000 7f449debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:23.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:23.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:23.512+0000 7f1e39eec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:23.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:23.518+0000 7f1e39eec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:23.784 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:59:23.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:59:23.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:23.913+0000 7f178145c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:23.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:23.924+0000 7f178145c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:24.789 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:59:24.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:59:24.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:24.920+0000 7fd366a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:24.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:24.929+0000 7fd366a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:25.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:25.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:25.728+0000 7f3d06e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:25.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:25.734+0000 7f3d06e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:59:25.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:59:25.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:25.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:25.926+0000 7f9fba311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:25.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:25.934+0000 7f9fba311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:59:26.121 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:59:26.133 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-16T16:59:25.916758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65208907,"num_objects":991,"num_object_clones":0,"num_object_copies":2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18552,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18526,"ondisk_log_size":18526,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":445564,"kb_used_data":445564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208745348,"statfs":{"total":214211493888,"available":213755236352,"internally_reserved":0,"allocated":456257536,"data_stored":456257536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000970"},"pg_stats":[{"pgid":"6.f","version":"80'1211","reported_seq":1289,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.707529+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:59:13.707529+0000","last_peered":"2024-09-16T16:59:13.707529+0000","last_clean":"2024-09-16T16:59:13.707529+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:59:13.707529+0000","last_undegraded":"2024-09-16T16:59:13.707529+0000","last_fullsized":"2024-09-16T16:59:13.707529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.596837+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:59:13.596837+0000","last_peered":"2024-09-16T16:59:13.596837+0000","last_clean":"2024-09-16T16:59:13.596837+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:59:13.596837+0000","last_undegraded":"2024-09-16T16:59:13.596837+0000","last_fullsized":"2024-09-16T16:59:13.596837+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'1161","reported_seq":1240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.648044+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:59:13.648044+0000","last_peered":"2024-09-16T16:59:13.648044+0000","last_clean":"2024-09-16T16:59:13.648044+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:59:13.648044+0000","last_undegraded":"2024-09-16T16:59:13.648044+0000","last_fullsized":"2024-09-16T16:59:13.648044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932184,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1161,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1221","reported_seq":1299,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.586908+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:59:13.586908+0000","last_peered":"2024-09-16T16:59:13.586908+0000","last_clean":"2024-09-16T16:59:13.586908+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:59:13.586908+0000","last_undegraded":"2024-09-16T16:59:13.586908+0000","last_fullsized":"2024-09-16T16:59:13.586908+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1189","reported_seq":1267,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.475419+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:59:13.475419+0000","last_peered":"2024-09-16T16:59:13.475419+0000","last_clean":"2024-09-16T16:59:13.475419+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:59:13.475419+0000","last_undegraded":"2024-09-16T16:59:13.475419+0000","last_fullsized":"2024-09-16T16:59:13.475419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'1152","reported_seq":1230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.398875+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:59:13.398875+0000","last_peered":"2024-09-16T16:59:13.398875+0000","last_clean":"2024-09-16T16:59:13.398875+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:59:13.398875+0000","last_undegraded":"2024-09-16T16:59:13.398875+0000","last_fullsized":"2024-09-16T16:59:13.398875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'1153","reported_seq":1231,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.158928+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:59:13.158928+0000","last_peered":"2024-09-16T16:59:13.158928+0000","last_clean":"2024-09-16T16:59:13.158928+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:59:13.158928+0000","last_undegraded":"2024-09-16T16:59:13.158928+0000","last_fullsized":"2024-09-16T16:59:13.158928+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'1190","reported_seq":1268,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.588400+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:59:13.588400+0000","last_peered":"2024-09-16T16:59:13.588400+0000","last_clean":"2024-09-16T16:59:13.588400+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:59:13.588400+0000","last_undegraded":"2024-09-16T16:59:13.588400+0000","last_fullsized":"2024-09-16T16:59:13.588400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'1128","reported_seq":1206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.606031+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:59:13.606031+0000","last_peered":"2024-09-16T16:59:13.606031+0000","last_clean":"2024-09-16T16:59:13.606031+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:59:13.606031+0000","last_undegraded":"2024-09-16T16:59:13.606031+0000","last_fullsized":"2024-09-16T16:59:13.606031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1128,"log_dups_size":0,"ondisk_log_size":1128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'1147","reported_seq":1225,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.780384+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:59:13.780384+0000","last_peered":"2024-09-16T16:59:13.780384+0000","last_clean":"2024-09-16T16:59:13.780384+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:59:13.780384+0000","last_undegraded":"2024-09-16T16:59:13.780384+0000","last_fullsized":"2024-09-16T16:59:13.780384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1208","reported_seq":1286,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.826437+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:59:13.826437+0000","last_peered":"2024-09-16T16:59:13.826437+0000","last_clean":"2024-09-16T16:59:13.826437+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:59:13.826437+0000","last_undegraded":"2024-09-16T16:59:13.826437+0000","last_fullsized":"2024-09-16T16:59:13.826437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'1166","reported_seq":1244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.675501+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:59:13.675501+0000","last_peered":"2024-09-16T16:59:13.675501+0000","last_clean":"2024-09-16T16:59:13.675501+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:59:13.675501+0000","last_undegraded":"2024-09-16T16:59:13.675501+0000","last_fullsized":"2024-09-16T16:59:13.675501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'1129","reported_seq":1207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.808180+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:59:13.808180+0000","last_peered":"2024-09-16T16:59:13.808180+0000","last_clean":"2024-09-16T16:59:13.808180+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:59:13.808180+0000","last_undegraded":"2024-09-16T16:59:13.808180+0000","last_fullsized":"2024-09-16T16:59:13.808180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.558487+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:59:13.558487+0000","last_peered":"2024-09-16T16:59:13.558487+0000","last_clean":"2024-09-16T16:59:13.558487+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:59:13.558487+0000","last_undegraded":"2024-09-16T16:59:13.558487+0000","last_fullsized":"2024-09-16T16:59:13.558487+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'1118","reported_seq":1196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.211522+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:59:13.211522+0000","last_peered":"2024-09-16T16:59:13.211522+0000","last_clean":"2024-09-16T16:59:13.211522+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:59:13.211522+0000","last_undegraded":"2024-09-16T16:59:13.211522+0000","last_fullsized":"2024-09-16T16:59:13.211522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'1052","reported_seq":1130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.514603+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:59:13.514603+0000","last_peered":"2024-09-16T16:59:13.514603+0000","last_clean":"2024-09-16T16:59:13.514603+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:59:13.514603+0000","last_undegraded":"2024-09-16T16:59:13.514603+0000","last_fullsized":"2024-09-16T16:59:13.514603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1052,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":64618520,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18471,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213782102016,"internally_reserved":0,"allocated":429391872,"data_stored":429391872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18471,"ondisk_log_size":18471,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213781970944,"internally_reserved":0,"allocated":429522944,"data_stored":429522944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":100944,"kb_used_data":100944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196784,"statfs":{"total":53552873472,"available":53449506816,"internally_reserved":0,"allocated":103366656,"data_stored":103366656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102916,"kb_used_data":102916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52194812,"statfs":{"total":53552873472,"available":53447487488,"internally_reserved":0,"allocated":105385984,"data_stored":105385984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":116524,"kb_used_data":116524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52181204,"statfs":{"total":53552873472,"available":53433552896,"internally_reserved":0,"allocated":119320576,"data_stored":119320576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":125180,"kb_used_data":125180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52172548,"statfs":{"total":53552873472,"available":53424689152,"internally_reserved":0,"allocated":128184320,"data_stored":128184320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434339328,"internally_reserved":0,"allocated":118534144,"data_stored":118534144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53434470400,"internally_reserved":0,"allocated":118403072,"data_stored":118403072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:26.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:26.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:26.238+0000 7f417b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:26.246+0000 7f417b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.428 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:59:26.428 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:59:26.441 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-16T16:59:25.916758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65208907,"num_objects":991,"num_object_clones":0,"num_object_copies":2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18552,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18526,"ondisk_log_size":18526,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":445564,"kb_used_data":445564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208745348,"statfs":{"total":214211493888,"available":213755236352,"internally_reserved":0,"allocated":456257536,"data_stored":456257536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000970"},"pg_stats":[{"pgid":"6.f","version":"80'1211","reported_seq":1289,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.707529+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:59:13.707529+0000","last_peered":"2024-09-16T16:59:13.707529+0000","last_clean":"2024-09-16T16:59:13.707529+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:59:13.707529+0000","last_undegraded":"2024-09-16T16:59:13.707529+0000","last_fullsized":"2024-09-16T16:59:13.707529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.596837+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:59:13.596837+0000","last_peered":"2024-09-16T16:59:13.596837+0000","last_clean":"2024-09-16T16:59:13.596837+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:59:13.596837+0000","last_undegraded":"2024-09-16T16:59:13.596837+0000","last_fullsized":"2024-09-16T16:59:13.596837+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'1161","reported_seq":1240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.648044+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:59:13.648044+0000","last_peered":"2024-09-16T16:59:13.648044+0000","last_clean":"2024-09-16T16:59:13.648044+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:59:13.648044+0000","last_undegraded":"2024-09-16T16:59:13.648044+0000","last_fullsized":"2024-09-16T16:59:13.648044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932184,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1161,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1221","reported_seq":1299,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.586908+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:59:13.586908+0000","last_peered":"2024-09-16T16:59:13.586908+0000","last_clean":"2024-09-16T16:59:13.586908+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:59:13.586908+0000","last_undegraded":"2024-09-16T16:59:13.586908+0000","last_fullsized":"2024-09-16T16:59:13.586908+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1189","reported_seq":1267,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.475419+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:59:13.475419+0000","last_peered":"2024-09-16T16:59:13.475419+0000","last_clean":"2024-09-16T16:59:13.475419+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:59:13.475419+0000","last_undegraded":"2024-09-16T16:59:13.475419+0000","last_fullsized":"2024-09-16T16:59:13.475419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'1152","reported_seq":1230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.398875+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:59:13.398875+0000","last_peered":"2024-09-16T16:59:13.398875+0000","last_clean":"2024-09-16T16:59:13.398875+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:59:13.398875+0000","last_undegraded":"2024-09-16T16:59:13.398875+0000","last_fullsized":"2024-09-16T16:59:13.398875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'1153","reported_seq":1231,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.158928+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:59:13.158928+0000","last_peered":"2024-09-16T16:59:13.158928+0000","last_clean":"2024-09-16T16:59:13.158928+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:59:13.158928+0000","last_undegraded":"2024-09-16T16:59:13.158928+0000","last_fullsized":"2024-09-16T16:59:13.158928+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'1190","reported_seq":1268,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.588400+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:59:13.588400+0000","last_peered":"2024-09-16T16:59:13.588400+0000","last_clean":"2024-09-16T16:59:13.588400+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:59:13.588400+0000","last_undegraded":"2024-09-16T16:59:13.588400+0000","last_fullsized":"2024-09-16T16:59:13.588400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'1128","reported_seq":1206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.606031+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:59:13.606031+0000","last_peered":"2024-09-16T16:59:13.606031+0000","last_clean":"2024-09-16T16:59:13.606031+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:59:13.606031+0000","last_undegraded":"2024-09-16T16:59:13.606031+0000","last_fullsized":"2024-09-16T16:59:13.606031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1128,"log_dups_size":0,"ondisk_log_size":1128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'1147","reported_seq":1225,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.780384+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:59:13.780384+0000","last_peered":"2024-09-16T16:59:13.780384+0000","last_clean":"2024-09-16T16:59:13.780384+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:59:13.780384+0000","last_undegraded":"2024-09-16T16:59:13.780384+0000","last_fullsized":"2024-09-16T16:59:13.780384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1208","reported_seq":1286,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.826437+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:59:13.826437+0000","last_peered":"2024-09-16T16:59:13.826437+0000","last_clean":"2024-09-16T16:59:13.826437+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:59:13.826437+0000","last_undegraded":"2024-09-16T16:59:13.826437+0000","last_fullsized":"2024-09-16T16:59:13.826437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'1166","reported_seq":1244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.675501+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:59:13.675501+0000","last_peered":"2024-09-16T16:59:13.675501+0000","last_clean":"2024-09-16T16:59:13.675501+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:59:13.675501+0000","last_undegraded":"2024-09-16T16:59:13.675501+0000","last_fullsized":"2024-09-16T16:59:13.675501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'1129","reported_seq":1207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.808180+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:59:13.808180+0000","last_peered":"2024-09-16T16:59:13.808180+0000","last_clean":"2024-09-16T16:59:13.808180+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:59:13.808180+0000","last_undegraded":"2024-09-16T16:59:13.808180+0000","last_fullsized":"2024-09-16T16:59:13.808180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.558487+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:59:13.558487+0000","last_peered":"2024-09-16T16:59:13.558487+0000","last_clean":"2024-09-16T16:59:13.558487+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:59:13.558487+0000","last_undegraded":"2024-09-16T16:59:13.558487+0000","last_fullsized":"2024-09-16T16:59:13.558487+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'1118","reported_seq":1196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.211522+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:59:13.211522+0000","last_peered":"2024-09-16T16:59:13.211522+0000","last_clean":"2024-09-16T16:59:13.211522+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:59:13.211522+0000","last_undegraded":"2024-09-16T16:59:13.211522+0000","last_fullsized":"2024-09-16T16:59:13.211522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'1052","reported_seq":1130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.514603+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:59:13.514603+0000","last_peered":"2024-09-16T16:59:13.514603+0000","last_clean":"2024-09-16T16:59:13.514603+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:59:13.514603+0000","last_undegraded":"2024-09-16T16:59:13.514603+0000","last_fullsized":"2024-09-16T16:59:13.514603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1052,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":64618520,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18471,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213782102016,"internally_reserved":0,"allocated":429391872,"data_stored":429391872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18471,"ondisk_log_size":18471,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213781970944,"internally_reserved":0,"allocated":429522944,"data_stored":429522944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":100944,"kb_used_data":100944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196784,"statfs":{"total":53552873472,"available":53449506816,"internally_reserved":0,"allocated":103366656,"data_stored":103366656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102916,"kb_used_data":102916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52194812,"statfs":{"total":53552873472,"available":53447487488,"internally_reserved":0,"allocated":105385984,"data_stored":105385984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":116524,"kb_used_data":116524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52181204,"statfs":{"total":53552873472,"available":53433552896,"internally_reserved":0,"allocated":119320576,"data_stored":119320576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":125180,"kb_used_data":125180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52172548,"statfs":{"total":53552873472,"available":53424689152,"internally_reserved":0,"allocated":128184320,"data_stored":128184320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434339328,"internally_reserved":0,"allocated":118534144,"data_stored":118534144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53434470400,"internally_reserved":0,"allocated":118403072,"data_stored":118403072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:26.442 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:59:26.442 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:26.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:26.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:26.546+0000 7fe95d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:26.553+0000 7fe95d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.736 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:59:26.737 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:59:26.749 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-16T16:59:25.916758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65208907,"num_objects":991,"num_object_clones":0,"num_object_copies":2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18552,"num_write_kb":623701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18526,"ondisk_log_size":18526,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":445564,"kb_used_data":445564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208745348,"statfs":{"total":214211493888,"available":213755236352,"internally_reserved":0,"allocated":456257536,"data_stored":456257536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000970"},"pg_stats":[{"pgid":"6.f","version":"80'1211","reported_seq":1289,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.707529+0000","last_change":"2024-09-16T16:56:23.958765+0000","last_active":"2024-09-16T16:59:13.707529+0000","last_peered":"2024-09-16T16:59:13.707529+0000","last_clean":"2024-09-16T16:59:13.707529+0000","last_became_active":"2024-09-16T16:56:23.943284+0000","last_became_peered":"2024-09-16T16:56:23.943284+0000","last_unstale":"2024-09-16T16:59:13.707529+0000","last_undegraded":"2024-09-16T16:59:13.707529+0000","last_fullsized":"2024-09-16T16:59:13.707529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.596837+0000","last_change":"2024-09-16T16:56:23.940553+0000","last_active":"2024-09-16T16:59:13.596837+0000","last_peered":"2024-09-16T16:59:13.596837+0000","last_clean":"2024-09-16T16:59:13.596837+0000","last_became_active":"2024-09-16T16:56:23.906204+0000","last_became_peered":"2024-09-16T16:56:23.906204+0000","last_unstale":"2024-09-16T16:59:13.596837+0000","last_undegraded":"2024-09-16T16:59:13.596837+0000","last_fullsized":"2024-09-16T16:59:13.596837+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"80'1161","reported_seq":1240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.648044+0000","last_change":"2024-09-16T16:56:24.035092+0000","last_active":"2024-09-16T16:59:13.648044+0000","last_peered":"2024-09-16T16:59:13.648044+0000","last_clean":"2024-09-16T16:59:13.648044+0000","last_became_active":"2024-09-16T16:56:24.024821+0000","last_became_peered":"2024-09-16T16:56:24.024821+0000","last_unstale":"2024-09-16T16:59:13.648044+0000","last_undegraded":"2024-09-16T16:59:13.648044+0000","last_fullsized":"2024-09-16T16:59:13.648044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932184,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1161,"num_write_kb":39041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"80'1221","reported_seq":1299,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.586908+0000","last_change":"2024-09-16T16:56:23.989480+0000","last_active":"2024-09-16T16:59:13.586908+0000","last_peered":"2024-09-16T16:59:13.586908+0000","last_clean":"2024-09-16T16:59:13.586908+0000","last_became_active":"2024-09-16T16:56:23.969482+0000","last_became_peered":"2024-09-16T16:56:23.969482+0000","last_unstale":"2024-09-16T16:59:13.586908+0000","last_undegraded":"2024-09-16T16:59:13.586908+0000","last_fullsized":"2024-09-16T16:59:13.586908+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1221,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"80'1189","reported_seq":1267,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.475419+0000","last_change":"2024-09-16T16:56:23.954482+0000","last_active":"2024-09-16T16:59:13.475419+0000","last_peered":"2024-09-16T16:59:13.475419+0000","last_clean":"2024-09-16T16:59:13.475419+0000","last_became_active":"2024-09-16T16:56:23.931241+0000","last_became_peered":"2024-09-16T16:56:23.931241+0000","last_unstale":"2024-09-16T16:59:13.475419+0000","last_undegraded":"2024-09-16T16:59:13.475419+0000","last_fullsized":"2024-09-16T16:59:13.475419+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"80'1152","reported_seq":1230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.398875+0000","last_change":"2024-09-16T16:56:23.927803+0000","last_active":"2024-09-16T16:59:13.398875+0000","last_peered":"2024-09-16T16:59:13.398875+0000","last_clean":"2024-09-16T16:59:13.398875+0000","last_became_active":"2024-09-16T16:56:23.920148+0000","last_became_peered":"2024-09-16T16:56:23.920148+0000","last_unstale":"2024-09-16T16:59:13.398875+0000","last_undegraded":"2024-09-16T16:59:13.398875+0000","last_fullsized":"2024-09-16T16:59:13.398875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"80'1153","reported_seq":1231,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.158928+0000","last_change":"2024-09-16T16:56:23.946957+0000","last_active":"2024-09-16T16:59:13.158928+0000","last_peered":"2024-09-16T16:59:13.158928+0000","last_clean":"2024-09-16T16:59:13.158928+0000","last_became_active":"2024-09-16T16:56:23.920311+0000","last_became_peered":"2024-09-16T16:56:23.920311+0000","last_unstale":"2024-09-16T16:59:13.158928+0000","last_undegraded":"2024-09-16T16:59:13.158928+0000","last_fullsized":"2024-09-16T16:59:13.158928+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"80'1190","reported_seq":1268,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.588400+0000","last_change":"2024-09-16T16:56:24.020323+0000","last_active":"2024-09-16T16:59:13.588400+0000","last_peered":"2024-09-16T16:59:13.588400+0000","last_clean":"2024-09-16T16:59:13.588400+0000","last_became_active":"2024-09-16T16:56:23.968784+0000","last_became_peered":"2024-09-16T16:56:23.968784+0000","last_unstale":"2024-09-16T16:59:13.588400+0000","last_undegraded":"2024-09-16T16:59:13.588400+0000","last_fullsized":"2024-09-16T16:59:13.588400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"80'1128","reported_seq":1206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.606031+0000","last_change":"2024-09-16T16:56:23.985860+0000","last_active":"2024-09-16T16:59:13.606031+0000","last_peered":"2024-09-16T16:59:13.606031+0000","last_clean":"2024-09-16T16:59:13.606031+0000","last_became_active":"2024-09-16T16:56:23.966508+0000","last_became_peered":"2024-09-16T16:56:23.966508+0000","last_unstale":"2024-09-16T16:59:13.606031+0000","last_undegraded":"2024-09-16T16:59:13.606031+0000","last_fullsized":"2024-09-16T16:59:13.606031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1128,"log_dups_size":0,"ondisk_log_size":1128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.848715+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:58:29.848715+0000","last_peered":"2024-09-16T16:58:29.848715+0000","last_clean":"2024-09-16T16:58:29.848715+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:58:29.848715+0000","last_undegraded":"2024-09-16T16:58:29.848715+0000","last_fullsized":"2024-09-16T16:58:29.848715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.855785+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:58:29.855785+0000","last_peered":"2024-09-16T16:58:29.855785+0000","last_clean":"2024-09-16T16:58:29.855785+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:58:29.855785+0000","last_undegraded":"2024-09-16T16:58:29.855785+0000","last_fullsized":"2024-09-16T16:58:29.855785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"80'1147","reported_seq":1225,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.780384+0000","last_change":"2024-09-16T16:56:24.002669+0000","last_active":"2024-09-16T16:59:13.780384+0000","last_peered":"2024-09-16T16:59:13.780384+0000","last_clean":"2024-09-16T16:59:13.780384+0000","last_became_active":"2024-09-16T16:56:23.989469+0000","last_became_peered":"2024-09-16T16:56:23.989469+0000","last_unstale":"2024-09-16T16:59:13.780384+0000","last_undegraded":"2024-09-16T16:59:13.780384+0000","last_fullsized":"2024-09-16T16:59:13.780384+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931071+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:58:29.931071+0000","last_peered":"2024-09-16T16:58:29.931071+0000","last_clean":"2024-09-16T16:58:29.931071+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:58:29.931071+0000","last_undegraded":"2024-09-16T16:58:29.931071+0000","last_fullsized":"2024-09-16T16:58:29.931071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"80'1208","reported_seq":1286,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.826437+0000","last_change":"2024-09-16T16:56:23.947546+0000","last_active":"2024-09-16T16:59:13.826437+0000","last_peered":"2024-09-16T16:59:13.826437+0000","last_clean":"2024-09-16T16:59:13.826437+0000","last_became_active":"2024-09-16T16:56:23.916142+0000","last_became_peered":"2024-09-16T16:56:23.916142+0000","last_unstale":"2024-09-16T16:59:13.826437+0000","last_undegraded":"2024-09-16T16:59:13.826437+0000","last_fullsized":"2024-09-16T16:59:13.826437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.846307+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:58:29.846307+0000","last_peered":"2024-09-16T16:58:29.846307+0000","last_clean":"2024-09-16T16:58:29.846307+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:58:29.846307+0000","last_undegraded":"2024-09-16T16:58:29.846307+0000","last_fullsized":"2024-09-16T16:58:29.846307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"80'1166","reported_seq":1244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.675501+0000","last_change":"2024-09-16T16:56:23.906428+0000","last_active":"2024-09-16T16:59:13.675501+0000","last_peered":"2024-09-16T16:59:13.675501+0000","last_clean":"2024-09-16T16:59:13.675501+0000","last_became_active":"2024-09-16T16:56:23.883084+0000","last_became_peered":"2024-09-16T16:56:23.883084+0000","last_unstale":"2024-09-16T16:59:13.675501+0000","last_undegraded":"2024-09-16T16:59:13.675501+0000","last_fullsized":"2024-09-16T16:59:13.675501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.931665+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:58:29.931665+0000","last_peered":"2024-09-16T16:58:29.931665+0000","last_clean":"2024-09-16T16:58:29.931665+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:58:29.931665+0000","last_undegraded":"2024-09-16T16:58:29.931665+0000","last_fullsized":"2024-09-16T16:58:29.931665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"80'1129","reported_seq":1207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.808180+0000","last_change":"2024-09-16T16:56:23.966493+0000","last_active":"2024-09-16T16:59:13.808180+0000","last_peered":"2024-09-16T16:59:13.808180+0000","last_clean":"2024-09-16T16:59:13.808180+0000","last_became_active":"2024-09-16T16:56:23.937863+0000","last_became_peered":"2024-09-16T16:56:23.937863+0000","last_unstale":"2024-09-16T16:59:13.808180+0000","last_undegraded":"2024-09-16T16:59:13.808180+0000","last_fullsized":"2024-09-16T16:59:13.808180+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1129,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.901865+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:58:29.901865+0000","last_peered":"2024-09-16T16:58:29.901865+0000","last_clean":"2024-09-16T16:58:29.901865+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:58:29.901865+0000","last_undegraded":"2024-09-16T16:58:29.901865+0000","last_fullsized":"2024-09-16T16:58:29.901865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"80'1123","reported_seq":1201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.558487+0000","last_change":"2024-09-16T16:56:23.990961+0000","last_active":"2024-09-16T16:59:13.558487+0000","last_peered":"2024-09-16T16:59:13.558487+0000","last_clean":"2024-09-16T16:59:13.558487+0000","last_became_active":"2024-09-16T16:56:23.970354+0000","last_became_peered":"2024-09-16T16:56:23.970354+0000","last_unstale":"2024-09-16T16:59:13.558487+0000","last_undegraded":"2024-09-16T16:59:13.558487+0000","last_fullsized":"2024-09-16T16:59:13.558487+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":38016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.853181+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:58:29.853181+0000","last_peered":"2024-09-16T16:58:29.853181+0000","last_clean":"2024-09-16T16:58:29.853181+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:58:29.853181+0000","last_undegraded":"2024-09-16T16:58:29.853181+0000","last_fullsized":"2024-09-16T16:58:29.853181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"80'1118","reported_seq":1196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.211522+0000","last_change":"2024-09-16T16:56:24.083186+0000","last_active":"2024-09-16T16:59:13.211522+0000","last_peered":"2024-09-16T16:59:13.211522+0000","last_clean":"2024-09-16T16:59:13.211522+0000","last_became_active":"2024-09-16T16:56:24.075349+0000","last_became_peered":"2024-09-16T16:56:24.075349+0000","last_unstale":"2024-09-16T16:59:13.211522+0000","last_undegraded":"2024-09-16T16:59:13.211522+0000","last_fullsized":"2024-09-16T16:59:13.211522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.895708+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:58:29.895708+0000","last_peered":"2024-09-16T16:58:29.895708+0000","last_clean":"2024-09-16T16:58:29.895708+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:58:29.895708+0000","last_undegraded":"2024-09-16T16:58:29.895708+0000","last_fullsized":"2024-09-16T16:58:29.895708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"80'1052","reported_seq":1130,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:13.514603+0000","last_change":"2024-09-16T16:56:23.944287+0000","last_active":"2024-09-16T16:59:13.514603+0000","last_peered":"2024-09-16T16:59:13.514603+0000","last_clean":"2024-09-16T16:59:13.514603+0000","last_became_active":"2024-09-16T16:56:23.935057+0000","last_became_peered":"2024-09-16T16:56:23.935057+0000","last_unstale":"2024-09-16T16:59:13.514603+0000","last_undegraded":"2024-09-16T16:59:13.514603+0000","last_fullsized":"2024-09-16T16:59:13.514603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:22.763047+0000","last_clean_scrub_stamp":"2024-09-16T16:56:22.763047+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1052,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:58:29.851332+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:58:29.851332+0000","last_peered":"2024-09-16T16:58:29.851332+0000","last_clean":"2024-09-16T16:58:29.851332+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:58:29.851332+0000","last_undegraded":"2024-09-16T16:58:29.851332+0000","last_fullsized":"2024-09-16T16:58:29.851332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":64618520,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18471,"num_write_kb":622593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213782102016,"internally_reserved":0,"allocated":429391872,"data_stored":429391872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18471,"ondisk_log_size":18471,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213781970944,"internally_reserved":0,"allocated":429522944,"data_stored":429522944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":100944,"kb_used_data":100944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196784,"statfs":{"total":53552873472,"available":53449506816,"internally_reserved":0,"allocated":103366656,"data_stored":103366656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102916,"kb_used_data":102916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52194812,"statfs":{"total":53552873472,"available":53447487488,"internally_reserved":0,"allocated":105385984,"data_stored":105385984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":116524,"kb_used_data":116524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52181204,"statfs":{"total":53552873472,"available":53433552896,"internally_reserved":0,"allocated":119320576,"data_stored":119320576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":125180,"kb_used_data":125180,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52172548,"statfs":{"total":53552873472,"available":53424689152,"internally_reserved":0,"allocated":128184320,"data_stored":128184320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434339328,"internally_reserved":0,"allocated":118534144,"data_stored":118534144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53434470400,"internally_reserved":0,"allocated":118403072,"data_stored":118403072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53436964864,"internally_reserved":0,"allocated":115908608,"data_stored":115908608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53457068032,"internally_reserved":0,"allocated":95805440,"data_stored":95805440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53453598720,"internally_reserved":0,"allocated":99274752,"data_stored":99274752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:27.836 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-16T16:59:27.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-16T16:59:27.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:27.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:27.953+0000 7f3f9c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:27.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:27.972+0000 7f3f9c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:28.013+0000 7f2de106c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:28.020+0000 7f2de106c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.970 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_3' removed 2024-09-16T16:59:28.993 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:59:28.994 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:59:28.995 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-16T16:59:28.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-16T16:59:29.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:29.159+0000 7febbcc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:29.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:29.178+0000 7febbcc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_4' created 2024-09-16T16:59:30.009 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-16T16:59:30.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:30.131+0000 7fee89c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:30.148+0000 7fee89c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:30.236+0000 7f214ce4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:30.242+0000 7f214ce4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.993 INFO:teuthology.orchestra.run.smithi103.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-16T16:59:31.752 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:31.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:31.752 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:31.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:31.861+0000 7f85fa951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:31.871+0000 7f85fa951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:31.887 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:31.887 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:31.887 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:31.887 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:31.888 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:31.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:31.891 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:31.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:32.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:31.994+0000 7fcb65591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.003+0000 7fcb65591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.013 DEBUG:teuthology.orchestra.run.smithi103:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-16T16:59:32.015 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:59:32.015 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:59:32.019 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:32.020 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:32.023 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:32.023 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:32.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:32.079 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:hints = 1 2024-09-16T16:59:32.079 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:59:32.079 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object prefix: benchmark_data_smithi103_60123 2024-09-16T16:59:32.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:59:32.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:59:32.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.212+0000 7fb4d6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.225+0000 7fb4d6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:32.245 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:32.246 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:32.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:32.252 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:32.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:32.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:32.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.425+0000 7ff9d3c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.437+0000 7ff9d3c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:32.491 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:32.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.509+0000 7efd4546c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:32.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:32.515+0000 7efd4546c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:33.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 1 16 89 73 4.56222 4.5625 0.0405744 0.167768 2024-09-16T16:59:34.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 2 16 183 167 5.21836 5.875 0.135261 0.170649 2024-09-16T16:59:34.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:34.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:34.836+0000 7fea5eca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:34.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:34.842+0000 7fea5eca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:35.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 3 16 283 267 5.56205 6.25 0.0984656 0.17063 2024-09-16T16:59:36.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 4 16 377 361 5.64011 5.875 0.0256399 0.169423 2024-09-16T16:59:37.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 5 16 473 457 5.71198 6 0.0963394 0.168724 2024-09-16T16:59:37.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:37.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.272+0000 7f8235991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.279+0000 7f8235991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.492 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:37.493 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:37.493 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:37.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:37.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.627+0000 7fa1afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.639+0000 7fa1afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:37.663 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:37.667 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:37.668 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:37.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:37.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.788+0000 7f1eb3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.799+0000 7f1eb3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.821 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:37.822 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:37.827 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:37.827 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:37.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:37.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.960+0000 7f2482c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:37.973+0000 7f2482c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:38.032 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:38.036 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:38.036 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:38.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:38.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 6 16 568 552 5.74942 5.9375 0.0572529 0.168329 2024-09-16T16:59:38.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:38.162+0000 7fa93cc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:38.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:38.174+0000 7fa93cc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:38.319 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:38.320 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:38.320 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:38.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:38.324 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:39.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 7 16 691 675 6.02619 7.6875 0.0633266 0.164085 2024-09-16T16:59:39.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:39.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:39.706+0000 7f606a151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:39.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:39.716+0000 7f606a151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:40.080 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 8 16 797 781 6.10096 6.625 0.19963 0.162062 2024-09-16T16:59:41.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 9 16 897 881 6.11746 6.25 0.319297 0.160746 2024-09-16T16:59:42.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 10 16 1002 986 6.16191 6.5625 0.281427 0.160548 2024-09-16T16:59:42.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:42.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:42.301+0000 7fba7c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:42.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:42.311+0000 7fba7c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 11 16 1115 1099 6.24372 7.0625 0.134345 0.158781 2024-09-16T16:59:43.325 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:43.325 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:43.326 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:43.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:43.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.468+0000 7f9ed6463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.482+0000 7f9ed6463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:43.544 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:43.545 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:43.547 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:43.547 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:43.548 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:43.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.685+0000 7ff7ae4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.697+0000 7ff7ae4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.727 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:43.728 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:43.729 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:43.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:43.732 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:43.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:43.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.866+0000 7fc9fb44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:43.883+0000 7fc9fb44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:43.909 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:43.910 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:43.914 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:43.914 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:43.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:44.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 12 16 1227 1211 6.3067 7 0.0893393 0.157772 2024-09-16T16:59:44.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:44.075+0000 7fb114591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:44.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:44.093+0000 7fb114591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:44.207 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:44.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:44.212 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:44.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:44.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:44.758+0000 7fafd94c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:44.766+0000 7fafd94c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:45.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 13 16 1333 1317 6.33114 6.625 0.16323 0.156315 2024-09-16T16:59:46.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 14 16 1445 1429 6.37887 7 0.0977573 0.155436 2024-09-16T16:59:47.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 15 16 1558 1542 6.42439 7.0625 0.0885096 0.154881 2024-09-16T16:59:47.107 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:47.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:47.257+0000 7f2c24191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:47.265+0000 7f2c24191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:48.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 16 16 1666 1650 6.4447 6.75 0.170848 0.153982 2024-09-16T16:59:49.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 17 16 1785 1769 6.50306 7.4375 0.0681143 0.15296 2024-09-16T16:59:49.212 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:49.212 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:49.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:49.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:49.360+0000 7f677347d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:49.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:49.373+0000 7f677347d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:49.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:49.711 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T16:59:49.712 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T16:59:49.737 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2024-09-16T16:59:47.921393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79364659,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1283,"num_write_kb":78036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1257,"ondisk_log_size":1257,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":451736,"kb_used_data":451736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208739176,"statfs":{"total":214211493888,"available":213748916224,"internally_reserved":0,"allocated":462577664,"data_stored":462577664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002649"},"pg_stats":[{"pgid":"7.f","version":"88'61","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.468452+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T16:59:43.468452+0000","last_peered":"2024-09-16T16:59:43.468452+0000","last_clean":"2024-09-16T16:59:43.468452+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T16:59:43.468452+0000","last_undegraded":"2024-09-16T16:59:43.468452+0000","last_fullsized":"2024-09-16T16:59:43.468452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.405508+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T16:59:43.405508+0000","last_peered":"2024-09-16T16:59:43.405508+0000","last_clean":"2024-09-16T16:59:43.405508+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T16:59:43.405508+0000","last_undegraded":"2024-09-16T16:59:43.405508+0000","last_fullsized":"2024-09-16T16:59:43.405508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.759985+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T16:59:43.759985+0000","last_peered":"2024-09-16T16:59:43.759985+0000","last_clean":"2024-09-16T16:59:43.759985+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T16:59:43.759985+0000","last_undegraded":"2024-09-16T16:59:43.759985+0000","last_fullsized":"2024-09-16T16:59:43.759985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.800459+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T16:59:43.800459+0000","last_peered":"2024-09-16T16:59:43.800459+0000","last_clean":"2024-09-16T16:59:43.800459+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T16:59:43.800459+0000","last_undegraded":"2024-09-16T16:59:43.800459+0000","last_fullsized":"2024-09-16T16:59:43.800459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'81","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.362917+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T16:59:43.362917+0000","last_peered":"2024-09-16T16:59:43.362917+0000","last_clean":"2024-09-16T16:59:43.362917+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T16:59:43.362917+0000","last_undegraded":"2024-09-16T16:59:43.362917+0000","last_fullsized":"2024-09-16T16:59:43.362917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"88'85","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.641287+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T16:59:43.641287+0000","last_peered":"2024-09-16T16:59:43.641287+0000","last_clean":"2024-09-16T16:59:43.641287+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T16:59:43.641287+0000","last_undegraded":"2024-09-16T16:59:43.641287+0000","last_fullsized":"2024-09-16T16:59:43.641287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"88'66","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.487222+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T16:59:43.487222+0000","last_peered":"2024-09-16T16:59:43.487222+0000","last_clean":"2024-09-16T16:59:43.487222+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T16:59:43.487222+0000","last_undegraded":"2024-09-16T16:59:43.487222+0000","last_fullsized":"2024-09-16T16:59:43.487222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"88'74","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.660733+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T16:59:43.660733+0000","last_peered":"2024-09-16T16:59:43.660733+0000","last_clean":"2024-09-16T16:59:43.660733+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T16:59:43.660733+0000","last_undegraded":"2024-09-16T16:59:43.660733+0000","last_fullsized":"2024-09-16T16:59:43.660733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"88'76","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.656175+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T16:59:43.656175+0000","last_peered":"2024-09-16T16:59:43.656175+0000","last_clean":"2024-09-16T16:59:43.656175+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T16:59:43.656175+0000","last_undegraded":"2024-09-16T16:59:43.656175+0000","last_fullsized":"2024-09-16T16:59:43.656175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.777133+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:59:31.777133+0000","last_peered":"2024-09-16T16:59:31.777133+0000","last_clean":"2024-09-16T16:59:31.777133+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:59:31.777133+0000","last_undegraded":"2024-09-16T16:59:31.777133+0000","last_fullsized":"2024-09-16T16:59:31.777133+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784039+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:59:31.784039+0000","last_peered":"2024-09-16T16:59:31.784039+0000","last_clean":"2024-09-16T16:59:31.784039+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:59:31.784039+0000","last_undegraded":"2024-09-16T16:59:31.784039+0000","last_fullsized":"2024-09-16T16:59:31.784039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"88'77","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.374374+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T16:59:43.374374+0000","last_peered":"2024-09-16T16:59:43.374374+0000","last_clean":"2024-09-16T16:59:43.374374+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T16:59:43.374374+0000","last_undegraded":"2024-09-16T16:59:43.374374+0000","last_fullsized":"2024-09-16T16:59:43.374374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786317+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:59:31.786317+0000","last_peered":"2024-09-16T16:59:31.786317+0000","last_clean":"2024-09-16T16:59:31.786317+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:59:31.786317+0000","last_undegraded":"2024-09-16T16:59:31.786317+0000","last_fullsized":"2024-09-16T16:59:31.786317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"88'82","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.926402+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T16:59:43.926402+0000","last_peered":"2024-09-16T16:59:43.926402+0000","last_clean":"2024-09-16T16:59:43.926402+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T16:59:43.926402+0000","last_undegraded":"2024-09-16T16:59:43.926402+0000","last_fullsized":"2024-09-16T16:59:43.926402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.778887+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:59:31.778887+0000","last_peered":"2024-09-16T16:59:31.778887+0000","last_clean":"2024-09-16T16:59:31.778887+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:59:31.778887+0000","last_undegraded":"2024-09-16T16:59:31.778887+0000","last_fullsized":"2024-09-16T16:59:31.778887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"88'79","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.230887+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T16:59:43.230887+0000","last_peered":"2024-09-16T16:59:43.230887+0000","last_clean":"2024-09-16T16:59:43.230887+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T16:59:43.230887+0000","last_undegraded":"2024-09-16T16:59:43.230887+0000","last_fullsized":"2024-09-16T16:59:43.230887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786034+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:59:31.786034+0000","last_peered":"2024-09-16T16:59:31.786034+0000","last_clean":"2024-09-16T16:59:31.786034+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:59:31.786034+0000","last_undegraded":"2024-09-16T16:59:31.786034+0000","last_fullsized":"2024-09-16T16:59:31.786034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"88'65","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.593441+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T16:59:43.593441+0000","last_peered":"2024-09-16T16:59:43.593441+0000","last_clean":"2024-09-16T16:59:43.593441+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T16:59:43.593441+0000","last_undegraded":"2024-09-16T16:59:43.593441+0000","last_fullsized":"2024-09-16T16:59:43.593441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786352+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:59:31.786352+0000","last_peered":"2024-09-16T16:59:31.786352+0000","last_clean":"2024-09-16T16:59:31.786352+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:59:31.786352+0000","last_undegraded":"2024-09-16T16:59:31.786352+0000","last_fullsized":"2024-09-16T16:59:31.786352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"88'88","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.659383+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T16:59:43.659383+0000","last_peered":"2024-09-16T16:59:43.659383+0000","last_clean":"2024-09-16T16:59:43.659383+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T16:59:43.659383+0000","last_undegraded":"2024-09-16T16:59:43.659383+0000","last_fullsized":"2024-09-16T16:59:43.659383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.785763+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:59:31.785763+0000","last_peered":"2024-09-16T16:59:31.785763+0000","last_clean":"2024-09-16T16:59:31.785763+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:59:31.785763+0000","last_undegraded":"2024-09-16T16:59:31.785763+0000","last_fullsized":"2024-09-16T16:59:31.785763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'80","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.816079+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T16:59:43.816079+0000","last_peered":"2024-09-16T16:59:43.816079+0000","last_clean":"2024-09-16T16:59:43.816079+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T16:59:43.816079+0000","last_undegraded":"2024-09-16T16:59:43.816079+0000","last_fullsized":"2024-09-16T16:59:43.816079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784878+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:59:31.784878+0000","last_peered":"2024-09-16T16:59:31.784878+0000","last_clean":"2024-09-16T16:59:31.784878+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:59:31.784878+0000","last_undegraded":"2024-09-16T16:59:31.784878+0000","last_fullsized":"2024-09-16T16:59:31.784878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.289749+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T16:59:43.289749+0000","last_peered":"2024-09-16T16:59:43.289749+0000","last_clean":"2024-09-16T16:59:43.289749+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T16:59:43.289749+0000","last_undegraded":"2024-09-16T16:59:43.289749+0000","last_fullsized":"2024-09-16T16:59:43.289749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786217+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:59:31.786217+0000","last_peered":"2024-09-16T16:59:31.786217+0000","last_clean":"2024-09-16T16:59:31.786217+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:59:31.786217+0000","last_undegraded":"2024-09-16T16:59:31.786217+0000","last_fullsized":"2024-09-16T16:59:31.786217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727506432,"internally_reserved":0,"allocated":483987456,"data_stored":483987456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1202,"ondisk_log_size":1202,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727637504,"internally_reserved":0,"allocated":483856384,"data_stored":483856384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143312,"kb_used_data":143312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154416,"statfs":{"total":53552873472,"available":53406121984,"internally_reserved":0,"allocated":146751488,"data_stored":146751488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83820,"kb_used_data":83820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213908,"statfs":{"total":53552873472,"available":53467041792,"internally_reserved":0,"allocated":85831680,"data_stored":85831680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":122776,"kb_used_data":122776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174952,"statfs":{"total":53552873472,"available":53427150848,"internally_reserved":0,"allocated":125722624,"data_stored":125722624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101828,"kb_used_data":101828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195900,"statfs":{"total":53552873472,"available":53448601600,"internally_reserved":0,"allocated":104271872,"data_stored":104271872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53402013696,"internally_reserved":0,"allocated":150859776,"data_stored":150859776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:49.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:49.818+0000 7f1433151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:49.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:49.825+0000 7f1433151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:50.081 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 18 16 1886 1870 6.49244 6.3125 0.158684 0.152395 2024-09-16T16:59:51.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 19 16 1981 1965 6.4632 5.9375 0.0395435 0.153536 2024-09-16T16:59:52.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T16:59:52.082057+0000 min lat: 0.0216933 max lat: 1.19893 avg lat: 0.154129 2024-09-16T16:59:52.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:59:52.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 20 16 2081 2065 6.45251 6.25 0.0804865 0.154129 2024-09-16T16:59:52.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:52.232+0000 7fe4a9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:52.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:52.239+0000 7fe4a9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:53.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 21 16 2177 2161 6.43093 6 0.0983076 0.154556 2024-09-16T16:59:54.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 22 16 2281 2265 6.43401 6.5 0.0989013 0.154781 2024-09-16T16:59:54.640 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:54.740 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:54.740 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:54.740 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:54.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:54.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:54.778+0000 7f6c9365c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:54.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:54.787+0000 7f6c9365c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:54.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:54.920+0000 7f14d7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:54.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:54.933+0000 7f14d7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:54.963 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:54.964 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:54.968 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:54.968 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:54.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:55.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 23 16 2371 2355 6.39882 5.625 0.0844207 0.155432 2024-09-16T16:59:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.152+0000 7fe34cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.168+0000 7fe34cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.334 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:55.336 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:55.336 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:55.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:55.340 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:55.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:55.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.515+0000 7fdb46591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.528+0000 7fdb46591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:55.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:55.601 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:55.601 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:55.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.736+0000 7f51ba488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:55.754+0000 7f51ba488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T16:59:55.793 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T16:59:55.794 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T16:59:55.796 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:55.796 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:56.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 24 16 2466 2450 6.37957 5.9375 0.158746 0.155848 2024-09-16T16:59:57.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 25 16 2545 2529 6.32187 4.9375 0.136491 0.156918 2024-09-16T16:59:57.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:57.362+0000 7f80e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:57.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:57.369+0000 7f80e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:58.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 26 16 2635 2619 6.29505 5.625 0.135011 0.157678 2024-09-16T16:59:59.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 27 16 2738 2722 6.30031 6.4375 0.102768 0.157905 2024-09-16T16:59:59.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:59.791+0000 7fa980646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T16:59:59.800+0000 7fa980646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:00.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 28 16 2847 2831 6.31858 6.8125 0.106248 0.157783 2024-09-16T17:00:00.797 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:00.797 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:00.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:00.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:00.973+0000 7f4243f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:00.985+0000 7f4243f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:01.082 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 29 16 2938 2922 6.2968 5.6875 0.106628 0.157985 2024-09-16T17:00:01.361 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:01.362 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:01.386 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-09-16T16:59:59.923672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79364659,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1283,"num_write_kb":78036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1257,"ondisk_log_size":1257,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":451736,"kb_used_data":451736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208739176,"statfs":{"total":214211493888,"available":213748916224,"internally_reserved":0,"allocated":462577664,"data_stored":462577664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002279"},"pg_stats":[{"pgid":"7.f","version":"88'61","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.468452+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T16:59:43.468452+0000","last_peered":"2024-09-16T16:59:43.468452+0000","last_clean":"2024-09-16T16:59:43.468452+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T16:59:43.468452+0000","last_undegraded":"2024-09-16T16:59:43.468452+0000","last_fullsized":"2024-09-16T16:59:43.468452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.405508+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T16:59:43.405508+0000","last_peered":"2024-09-16T16:59:43.405508+0000","last_clean":"2024-09-16T16:59:43.405508+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T16:59:43.405508+0000","last_undegraded":"2024-09-16T16:59:43.405508+0000","last_fullsized":"2024-09-16T16:59:43.405508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.759985+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T16:59:43.759985+0000","last_peered":"2024-09-16T16:59:43.759985+0000","last_clean":"2024-09-16T16:59:43.759985+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T16:59:43.759985+0000","last_undegraded":"2024-09-16T16:59:43.759985+0000","last_fullsized":"2024-09-16T16:59:43.759985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.800459+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T16:59:43.800459+0000","last_peered":"2024-09-16T16:59:43.800459+0000","last_clean":"2024-09-16T16:59:43.800459+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T16:59:43.800459+0000","last_undegraded":"2024-09-16T16:59:43.800459+0000","last_fullsized":"2024-09-16T16:59:43.800459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'81","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.362917+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T16:59:43.362917+0000","last_peered":"2024-09-16T16:59:43.362917+0000","last_clean":"2024-09-16T16:59:43.362917+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T16:59:43.362917+0000","last_undegraded":"2024-09-16T16:59:43.362917+0000","last_fullsized":"2024-09-16T16:59:43.362917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"88'85","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.641287+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T16:59:43.641287+0000","last_peered":"2024-09-16T16:59:43.641287+0000","last_clean":"2024-09-16T16:59:43.641287+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T16:59:43.641287+0000","last_undegraded":"2024-09-16T16:59:43.641287+0000","last_fullsized":"2024-09-16T16:59:43.641287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"88'66","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.487222+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T16:59:43.487222+0000","last_peered":"2024-09-16T16:59:43.487222+0000","last_clean":"2024-09-16T16:59:43.487222+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T16:59:43.487222+0000","last_undegraded":"2024-09-16T16:59:43.487222+0000","last_fullsized":"2024-09-16T16:59:43.487222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"88'74","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.660733+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T16:59:43.660733+0000","last_peered":"2024-09-16T16:59:43.660733+0000","last_clean":"2024-09-16T16:59:43.660733+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T16:59:43.660733+0000","last_undegraded":"2024-09-16T16:59:43.660733+0000","last_fullsized":"2024-09-16T16:59:43.660733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"88'76","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.656175+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T16:59:43.656175+0000","last_peered":"2024-09-16T16:59:43.656175+0000","last_clean":"2024-09-16T16:59:43.656175+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T16:59:43.656175+0000","last_undegraded":"2024-09-16T16:59:43.656175+0000","last_fullsized":"2024-09-16T16:59:43.656175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.777133+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:59:31.777133+0000","last_peered":"2024-09-16T16:59:31.777133+0000","last_clean":"2024-09-16T16:59:31.777133+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:59:31.777133+0000","last_undegraded":"2024-09-16T16:59:31.777133+0000","last_fullsized":"2024-09-16T16:59:31.777133+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784039+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:59:31.784039+0000","last_peered":"2024-09-16T16:59:31.784039+0000","last_clean":"2024-09-16T16:59:31.784039+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:59:31.784039+0000","last_undegraded":"2024-09-16T16:59:31.784039+0000","last_fullsized":"2024-09-16T16:59:31.784039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"88'77","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.374374+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T16:59:43.374374+0000","last_peered":"2024-09-16T16:59:43.374374+0000","last_clean":"2024-09-16T16:59:43.374374+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T16:59:43.374374+0000","last_undegraded":"2024-09-16T16:59:43.374374+0000","last_fullsized":"2024-09-16T16:59:43.374374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786317+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:59:31.786317+0000","last_peered":"2024-09-16T16:59:31.786317+0000","last_clean":"2024-09-16T16:59:31.786317+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:59:31.786317+0000","last_undegraded":"2024-09-16T16:59:31.786317+0000","last_fullsized":"2024-09-16T16:59:31.786317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"88'82","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.926402+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T16:59:43.926402+0000","last_peered":"2024-09-16T16:59:43.926402+0000","last_clean":"2024-09-16T16:59:43.926402+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T16:59:43.926402+0000","last_undegraded":"2024-09-16T16:59:43.926402+0000","last_fullsized":"2024-09-16T16:59:43.926402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.778887+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:59:31.778887+0000","last_peered":"2024-09-16T16:59:31.778887+0000","last_clean":"2024-09-16T16:59:31.778887+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:59:31.778887+0000","last_undegraded":"2024-09-16T16:59:31.778887+0000","last_fullsized":"2024-09-16T16:59:31.778887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"88'79","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.230887+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T16:59:43.230887+0000","last_peered":"2024-09-16T16:59:43.230887+0000","last_clean":"2024-09-16T16:59:43.230887+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T16:59:43.230887+0000","last_undegraded":"2024-09-16T16:59:43.230887+0000","last_fullsized":"2024-09-16T16:59:43.230887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786034+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:59:31.786034+0000","last_peered":"2024-09-16T16:59:31.786034+0000","last_clean":"2024-09-16T16:59:31.786034+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:59:31.786034+0000","last_undegraded":"2024-09-16T16:59:31.786034+0000","last_fullsized":"2024-09-16T16:59:31.786034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"88'65","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.593441+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T16:59:43.593441+0000","last_peered":"2024-09-16T16:59:43.593441+0000","last_clean":"2024-09-16T16:59:43.593441+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T16:59:43.593441+0000","last_undegraded":"2024-09-16T16:59:43.593441+0000","last_fullsized":"2024-09-16T16:59:43.593441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786352+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:59:31.786352+0000","last_peered":"2024-09-16T16:59:31.786352+0000","last_clean":"2024-09-16T16:59:31.786352+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:59:31.786352+0000","last_undegraded":"2024-09-16T16:59:31.786352+0000","last_fullsized":"2024-09-16T16:59:31.786352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"88'88","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.659383+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T16:59:43.659383+0000","last_peered":"2024-09-16T16:59:43.659383+0000","last_clean":"2024-09-16T16:59:43.659383+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T16:59:43.659383+0000","last_undegraded":"2024-09-16T16:59:43.659383+0000","last_fullsized":"2024-09-16T16:59:43.659383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.785763+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:59:31.785763+0000","last_peered":"2024-09-16T16:59:31.785763+0000","last_clean":"2024-09-16T16:59:31.785763+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:59:31.785763+0000","last_undegraded":"2024-09-16T16:59:31.785763+0000","last_fullsized":"2024-09-16T16:59:31.785763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'80","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.816079+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T16:59:43.816079+0000","last_peered":"2024-09-16T16:59:43.816079+0000","last_clean":"2024-09-16T16:59:43.816079+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T16:59:43.816079+0000","last_undegraded":"2024-09-16T16:59:43.816079+0000","last_fullsized":"2024-09-16T16:59:43.816079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784878+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:59:31.784878+0000","last_peered":"2024-09-16T16:59:31.784878+0000","last_clean":"2024-09-16T16:59:31.784878+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:59:31.784878+0000","last_undegraded":"2024-09-16T16:59:31.784878+0000","last_fullsized":"2024-09-16T16:59:31.784878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.289749+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T16:59:43.289749+0000","last_peered":"2024-09-16T16:59:43.289749+0000","last_clean":"2024-09-16T16:59:43.289749+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T16:59:43.289749+0000","last_undegraded":"2024-09-16T16:59:43.289749+0000","last_fullsized":"2024-09-16T16:59:43.289749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786217+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:59:31.786217+0000","last_peered":"2024-09-16T16:59:31.786217+0000","last_clean":"2024-09-16T16:59:31.786217+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:59:31.786217+0000","last_undegraded":"2024-09-16T16:59:31.786217+0000","last_fullsized":"2024-09-16T16:59:31.786217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727506432,"internally_reserved":0,"allocated":483987456,"data_stored":483987456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1202,"ondisk_log_size":1202,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727637504,"internally_reserved":0,"allocated":483856384,"data_stored":483856384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143312,"kb_used_data":143312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154416,"statfs":{"total":53552873472,"available":53406121984,"internally_reserved":0,"allocated":146751488,"data_stored":146751488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83820,"kb_used_data":83820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213908,"statfs":{"total":53552873472,"available":53467041792,"internally_reserved":0,"allocated":85831680,"data_stored":85831680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":122776,"kb_used_data":122776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174952,"statfs":{"total":53552873472,"available":53427150848,"internally_reserved":0,"allocated":125722624,"data_stored":125722624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101828,"kb_used_data":101828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195900,"statfs":{"total":53552873472,"available":53448601600,"internally_reserved":0,"allocated":104271872,"data_stored":104271872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53402013696,"internally_reserved":0,"allocated":150859776,"data_stored":150859776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:02.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 30 16 3038 3022 6.29522 6.25 0.163832 0.158388 2024-09-16T17:00:02.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:02.249+0000 7f8277d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:02.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:02.257+0000 7f8277d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:03.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 31 16 3142 3126 6.3018 6.5 0.251656 0.158184 2024-09-16T17:00:04.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 32 16 3263 3247 6.34118 7.5625 0.062745 0.157178 2024-09-16T17:00:04.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:04.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:04.917+0000 7f06d5693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:04.926+0000 7f06d5693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:05.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 33 16 3375 3359 6.36112 7 0.103683 0.156752 2024-09-16T17:00:06.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 34 15 3486 3471 6.3799 7 0.189278 0.156292 2024-09-16T17:00:06.388 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:06.388 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:00:06.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:06.523+0000 7f6f94663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:06.541+0000 7f6f94663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:07.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 35 16 3599 3583 6.3976 7 0.290106 0.155748 2024-09-16T17:00:07.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:07.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:07.402+0000 7f0a79591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:07.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:07.412+0000 7f0a79591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:07.794 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:00:07.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:00:07.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:07.953+0000 7f631a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:07.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:07.972+0000 7f631a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:08.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 36 16 3693 3677 6.38306 5.875 0.0777255 0.155924 2024-09-16T17:00:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:00:08.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:00:08.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:08.985+0000 7f4a9c49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:09.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:08.999+0000 7f4a9c49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:09.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 37 16 3809 3793 6.40648 7.25 0.289659 0.15557 2024-09-16T17:00:09.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:09.809 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:00:09.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:00:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:09.891+0000 7fb628391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:09.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:09.900+0000 7fb628391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:10.006+0000 7f86a06d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:10.026+0000 7f86a06d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 38 16 3918 3902 6.41715 6.8125 0.170888 0.155539 2024-09-16T17:00:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:00:10.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:00:10.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:10.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:10.958+0000 7f9d910ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:10.969+0000 7f9d910ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:11.083 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 39 16 4016 4000 6.40964 6.125 0.272475 0.155607 2024-09-16T17:00:11.321 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:11.322 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:11.340 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":486,"stamp":"2024-09-16T17:00:10.819110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79364659,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1283,"num_write_kb":78036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1257,"ondisk_log_size":1257,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":451736,"kb_used_data":451736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208739176,"statfs":{"total":214211493888,"available":213748916224,"internally_reserved":0,"allocated":462577664,"data_stored":462577664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894233"},"pg_stats":[{"pgid":"7.f","version":"88'61","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.468452+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T16:59:43.468452+0000","last_peered":"2024-09-16T16:59:43.468452+0000","last_clean":"2024-09-16T16:59:43.468452+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T16:59:43.468452+0000","last_undegraded":"2024-09-16T16:59:43.468452+0000","last_fullsized":"2024-09-16T16:59:43.468452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.405508+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T16:59:43.405508+0000","last_peered":"2024-09-16T16:59:43.405508+0000","last_clean":"2024-09-16T16:59:43.405508+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T16:59:43.405508+0000","last_undegraded":"2024-09-16T16:59:43.405508+0000","last_fullsized":"2024-09-16T16:59:43.405508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.759985+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T16:59:43.759985+0000","last_peered":"2024-09-16T16:59:43.759985+0000","last_clean":"2024-09-16T16:59:43.759985+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T16:59:43.759985+0000","last_undegraded":"2024-09-16T16:59:43.759985+0000","last_fullsized":"2024-09-16T16:59:43.759985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.800459+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T16:59:43.800459+0000","last_peered":"2024-09-16T16:59:43.800459+0000","last_clean":"2024-09-16T16:59:43.800459+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T16:59:43.800459+0000","last_undegraded":"2024-09-16T16:59:43.800459+0000","last_fullsized":"2024-09-16T16:59:43.800459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'81","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.362917+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T16:59:43.362917+0000","last_peered":"2024-09-16T16:59:43.362917+0000","last_clean":"2024-09-16T16:59:43.362917+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T16:59:43.362917+0000","last_undegraded":"2024-09-16T16:59:43.362917+0000","last_fullsized":"2024-09-16T16:59:43.362917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"88'85","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.641287+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T16:59:43.641287+0000","last_peered":"2024-09-16T16:59:43.641287+0000","last_clean":"2024-09-16T16:59:43.641287+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T16:59:43.641287+0000","last_undegraded":"2024-09-16T16:59:43.641287+0000","last_fullsized":"2024-09-16T16:59:43.641287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"88'66","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.487222+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T16:59:43.487222+0000","last_peered":"2024-09-16T16:59:43.487222+0000","last_clean":"2024-09-16T16:59:43.487222+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T16:59:43.487222+0000","last_undegraded":"2024-09-16T16:59:43.487222+0000","last_fullsized":"2024-09-16T16:59:43.487222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"88'74","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.660733+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T16:59:43.660733+0000","last_peered":"2024-09-16T16:59:43.660733+0000","last_clean":"2024-09-16T16:59:43.660733+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T16:59:43.660733+0000","last_undegraded":"2024-09-16T16:59:43.660733+0000","last_fullsized":"2024-09-16T16:59:43.660733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"88'76","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.656175+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T16:59:43.656175+0000","last_peered":"2024-09-16T16:59:43.656175+0000","last_clean":"2024-09-16T16:59:43.656175+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T16:59:43.656175+0000","last_undegraded":"2024-09-16T16:59:43.656175+0000","last_fullsized":"2024-09-16T16:59:43.656175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.777133+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:59:31.777133+0000","last_peered":"2024-09-16T16:59:31.777133+0000","last_clean":"2024-09-16T16:59:31.777133+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:59:31.777133+0000","last_undegraded":"2024-09-16T16:59:31.777133+0000","last_fullsized":"2024-09-16T16:59:31.777133+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784039+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:59:31.784039+0000","last_peered":"2024-09-16T16:59:31.784039+0000","last_clean":"2024-09-16T16:59:31.784039+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:59:31.784039+0000","last_undegraded":"2024-09-16T16:59:31.784039+0000","last_fullsized":"2024-09-16T16:59:31.784039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"88'77","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.374374+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T16:59:43.374374+0000","last_peered":"2024-09-16T16:59:43.374374+0000","last_clean":"2024-09-16T16:59:43.374374+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T16:59:43.374374+0000","last_undegraded":"2024-09-16T16:59:43.374374+0000","last_fullsized":"2024-09-16T16:59:43.374374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786317+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:59:31.786317+0000","last_peered":"2024-09-16T16:59:31.786317+0000","last_clean":"2024-09-16T16:59:31.786317+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:59:31.786317+0000","last_undegraded":"2024-09-16T16:59:31.786317+0000","last_fullsized":"2024-09-16T16:59:31.786317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"88'82","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.926402+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T16:59:43.926402+0000","last_peered":"2024-09-16T16:59:43.926402+0000","last_clean":"2024-09-16T16:59:43.926402+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T16:59:43.926402+0000","last_undegraded":"2024-09-16T16:59:43.926402+0000","last_fullsized":"2024-09-16T16:59:43.926402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.778887+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:59:31.778887+0000","last_peered":"2024-09-16T16:59:31.778887+0000","last_clean":"2024-09-16T16:59:31.778887+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:59:31.778887+0000","last_undegraded":"2024-09-16T16:59:31.778887+0000","last_fullsized":"2024-09-16T16:59:31.778887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"88'79","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.230887+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T16:59:43.230887+0000","last_peered":"2024-09-16T16:59:43.230887+0000","last_clean":"2024-09-16T16:59:43.230887+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T16:59:43.230887+0000","last_undegraded":"2024-09-16T16:59:43.230887+0000","last_fullsized":"2024-09-16T16:59:43.230887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786034+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:59:31.786034+0000","last_peered":"2024-09-16T16:59:31.786034+0000","last_clean":"2024-09-16T16:59:31.786034+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:59:31.786034+0000","last_undegraded":"2024-09-16T16:59:31.786034+0000","last_fullsized":"2024-09-16T16:59:31.786034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"88'65","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.593441+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T16:59:43.593441+0000","last_peered":"2024-09-16T16:59:43.593441+0000","last_clean":"2024-09-16T16:59:43.593441+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T16:59:43.593441+0000","last_undegraded":"2024-09-16T16:59:43.593441+0000","last_fullsized":"2024-09-16T16:59:43.593441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786352+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:59:31.786352+0000","last_peered":"2024-09-16T16:59:31.786352+0000","last_clean":"2024-09-16T16:59:31.786352+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:59:31.786352+0000","last_undegraded":"2024-09-16T16:59:31.786352+0000","last_fullsized":"2024-09-16T16:59:31.786352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"88'88","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.659383+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T16:59:43.659383+0000","last_peered":"2024-09-16T16:59:43.659383+0000","last_clean":"2024-09-16T16:59:43.659383+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T16:59:43.659383+0000","last_undegraded":"2024-09-16T16:59:43.659383+0000","last_fullsized":"2024-09-16T16:59:43.659383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.785763+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:59:31.785763+0000","last_peered":"2024-09-16T16:59:31.785763+0000","last_clean":"2024-09-16T16:59:31.785763+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:59:31.785763+0000","last_undegraded":"2024-09-16T16:59:31.785763+0000","last_fullsized":"2024-09-16T16:59:31.785763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'80","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.816079+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T16:59:43.816079+0000","last_peered":"2024-09-16T16:59:43.816079+0000","last_clean":"2024-09-16T16:59:43.816079+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T16:59:43.816079+0000","last_undegraded":"2024-09-16T16:59:43.816079+0000","last_fullsized":"2024-09-16T16:59:43.816079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784878+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:59:31.784878+0000","last_peered":"2024-09-16T16:59:31.784878+0000","last_clean":"2024-09-16T16:59:31.784878+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:59:31.784878+0000","last_undegraded":"2024-09-16T16:59:31.784878+0000","last_fullsized":"2024-09-16T16:59:31.784878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.289749+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T16:59:43.289749+0000","last_peered":"2024-09-16T16:59:43.289749+0000","last_clean":"2024-09-16T16:59:43.289749+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T16:59:43.289749+0000","last_undegraded":"2024-09-16T16:59:43.289749+0000","last_fullsized":"2024-09-16T16:59:43.289749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786217+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:59:31.786217+0000","last_peered":"2024-09-16T16:59:31.786217+0000","last_clean":"2024-09-16T16:59:31.786217+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:59:31.786217+0000","last_undegraded":"2024-09-16T16:59:31.786217+0000","last_fullsized":"2024-09-16T16:59:31.786217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727506432,"internally_reserved":0,"allocated":483987456,"data_stored":483987456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1202,"ondisk_log_size":1202,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727637504,"internally_reserved":0,"allocated":483856384,"data_stored":483856384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143312,"kb_used_data":143312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154416,"statfs":{"total":53552873472,"available":53406121984,"internally_reserved":0,"allocated":146751488,"data_stored":146751488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83820,"kb_used_data":83820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213908,"statfs":{"total":53552873472,"available":53467041792,"internally_reserved":0,"allocated":85831680,"data_stored":85831680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":122776,"kb_used_data":122776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174952,"statfs":{"total":53552873472,"available":53427150848,"internally_reserved":0,"allocated":125722624,"data_stored":125722624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101828,"kb_used_data":101828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195900,"statfs":{"total":53552873472,"available":53448601600,"internally_reserved":0,"allocated":104271872,"data_stored":104271872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53402013696,"internally_reserved":0,"allocated":150859776,"data_stored":150859776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:11.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:11.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:11.473+0000 7f3774391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:11.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:11.486+0000 7f3774391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:11.726 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:11.726 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:11.749 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":486,"stamp":"2024-09-16T17:00:10.819110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79364659,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1283,"num_write_kb":78036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1257,"ondisk_log_size":1257,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":451736,"kb_used_data":451736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208739176,"statfs":{"total":214211493888,"available":213748916224,"internally_reserved":0,"allocated":462577664,"data_stored":462577664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894233"},"pg_stats":[{"pgid":"7.f","version":"88'61","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.468452+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T16:59:43.468452+0000","last_peered":"2024-09-16T16:59:43.468452+0000","last_clean":"2024-09-16T16:59:43.468452+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T16:59:43.468452+0000","last_undegraded":"2024-09-16T16:59:43.468452+0000","last_fullsized":"2024-09-16T16:59:43.468452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.405508+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T16:59:43.405508+0000","last_peered":"2024-09-16T16:59:43.405508+0000","last_clean":"2024-09-16T16:59:43.405508+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T16:59:43.405508+0000","last_undegraded":"2024-09-16T16:59:43.405508+0000","last_fullsized":"2024-09-16T16:59:43.405508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.759985+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T16:59:43.759985+0000","last_peered":"2024-09-16T16:59:43.759985+0000","last_clean":"2024-09-16T16:59:43.759985+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T16:59:43.759985+0000","last_undegraded":"2024-09-16T16:59:43.759985+0000","last_fullsized":"2024-09-16T16:59:43.759985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.800459+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T16:59:43.800459+0000","last_peered":"2024-09-16T16:59:43.800459+0000","last_clean":"2024-09-16T16:59:43.800459+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T16:59:43.800459+0000","last_undegraded":"2024-09-16T16:59:43.800459+0000","last_fullsized":"2024-09-16T16:59:43.800459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'81","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.362917+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T16:59:43.362917+0000","last_peered":"2024-09-16T16:59:43.362917+0000","last_clean":"2024-09-16T16:59:43.362917+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T16:59:43.362917+0000","last_undegraded":"2024-09-16T16:59:43.362917+0000","last_fullsized":"2024-09-16T16:59:43.362917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"88'85","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.641287+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T16:59:43.641287+0000","last_peered":"2024-09-16T16:59:43.641287+0000","last_clean":"2024-09-16T16:59:43.641287+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T16:59:43.641287+0000","last_undegraded":"2024-09-16T16:59:43.641287+0000","last_fullsized":"2024-09-16T16:59:43.641287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"88'66","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.487222+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T16:59:43.487222+0000","last_peered":"2024-09-16T16:59:43.487222+0000","last_clean":"2024-09-16T16:59:43.487222+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T16:59:43.487222+0000","last_undegraded":"2024-09-16T16:59:43.487222+0000","last_fullsized":"2024-09-16T16:59:43.487222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"88'74","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.660733+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T16:59:43.660733+0000","last_peered":"2024-09-16T16:59:43.660733+0000","last_clean":"2024-09-16T16:59:43.660733+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T16:59:43.660733+0000","last_undegraded":"2024-09-16T16:59:43.660733+0000","last_fullsized":"2024-09-16T16:59:43.660733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"88'76","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.656175+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T16:59:43.656175+0000","last_peered":"2024-09-16T16:59:43.656175+0000","last_clean":"2024-09-16T16:59:43.656175+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T16:59:43.656175+0000","last_undegraded":"2024-09-16T16:59:43.656175+0000","last_fullsized":"2024-09-16T16:59:43.656175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.777133+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:59:31.777133+0000","last_peered":"2024-09-16T16:59:31.777133+0000","last_clean":"2024-09-16T16:59:31.777133+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:59:31.777133+0000","last_undegraded":"2024-09-16T16:59:31.777133+0000","last_fullsized":"2024-09-16T16:59:31.777133+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784039+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:59:31.784039+0000","last_peered":"2024-09-16T16:59:31.784039+0000","last_clean":"2024-09-16T16:59:31.784039+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:59:31.784039+0000","last_undegraded":"2024-09-16T16:59:31.784039+0000","last_fullsized":"2024-09-16T16:59:31.784039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"88'77","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.374374+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T16:59:43.374374+0000","last_peered":"2024-09-16T16:59:43.374374+0000","last_clean":"2024-09-16T16:59:43.374374+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T16:59:43.374374+0000","last_undegraded":"2024-09-16T16:59:43.374374+0000","last_fullsized":"2024-09-16T16:59:43.374374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786317+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:59:31.786317+0000","last_peered":"2024-09-16T16:59:31.786317+0000","last_clean":"2024-09-16T16:59:31.786317+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:59:31.786317+0000","last_undegraded":"2024-09-16T16:59:31.786317+0000","last_fullsized":"2024-09-16T16:59:31.786317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"88'82","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.926402+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T16:59:43.926402+0000","last_peered":"2024-09-16T16:59:43.926402+0000","last_clean":"2024-09-16T16:59:43.926402+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T16:59:43.926402+0000","last_undegraded":"2024-09-16T16:59:43.926402+0000","last_fullsized":"2024-09-16T16:59:43.926402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.778887+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:59:31.778887+0000","last_peered":"2024-09-16T16:59:31.778887+0000","last_clean":"2024-09-16T16:59:31.778887+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:59:31.778887+0000","last_undegraded":"2024-09-16T16:59:31.778887+0000","last_fullsized":"2024-09-16T16:59:31.778887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"88'79","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.230887+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T16:59:43.230887+0000","last_peered":"2024-09-16T16:59:43.230887+0000","last_clean":"2024-09-16T16:59:43.230887+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T16:59:43.230887+0000","last_undegraded":"2024-09-16T16:59:43.230887+0000","last_fullsized":"2024-09-16T16:59:43.230887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786034+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:59:31.786034+0000","last_peered":"2024-09-16T16:59:31.786034+0000","last_clean":"2024-09-16T16:59:31.786034+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:59:31.786034+0000","last_undegraded":"2024-09-16T16:59:31.786034+0000","last_fullsized":"2024-09-16T16:59:31.786034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"88'65","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.593441+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T16:59:43.593441+0000","last_peered":"2024-09-16T16:59:43.593441+0000","last_clean":"2024-09-16T16:59:43.593441+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T16:59:43.593441+0000","last_undegraded":"2024-09-16T16:59:43.593441+0000","last_fullsized":"2024-09-16T16:59:43.593441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786352+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:59:31.786352+0000","last_peered":"2024-09-16T16:59:31.786352+0000","last_clean":"2024-09-16T16:59:31.786352+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:59:31.786352+0000","last_undegraded":"2024-09-16T16:59:31.786352+0000","last_fullsized":"2024-09-16T16:59:31.786352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"88'88","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.659383+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T16:59:43.659383+0000","last_peered":"2024-09-16T16:59:43.659383+0000","last_clean":"2024-09-16T16:59:43.659383+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T16:59:43.659383+0000","last_undegraded":"2024-09-16T16:59:43.659383+0000","last_fullsized":"2024-09-16T16:59:43.659383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.785763+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:59:31.785763+0000","last_peered":"2024-09-16T16:59:31.785763+0000","last_clean":"2024-09-16T16:59:31.785763+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:59:31.785763+0000","last_undegraded":"2024-09-16T16:59:31.785763+0000","last_fullsized":"2024-09-16T16:59:31.785763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'80","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.816079+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T16:59:43.816079+0000","last_peered":"2024-09-16T16:59:43.816079+0000","last_clean":"2024-09-16T16:59:43.816079+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T16:59:43.816079+0000","last_undegraded":"2024-09-16T16:59:43.816079+0000","last_fullsized":"2024-09-16T16:59:43.816079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784878+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:59:31.784878+0000","last_peered":"2024-09-16T16:59:31.784878+0000","last_clean":"2024-09-16T16:59:31.784878+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:59:31.784878+0000","last_undegraded":"2024-09-16T16:59:31.784878+0000","last_fullsized":"2024-09-16T16:59:31.784878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.289749+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T16:59:43.289749+0000","last_peered":"2024-09-16T16:59:43.289749+0000","last_clean":"2024-09-16T16:59:43.289749+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T16:59:43.289749+0000","last_undegraded":"2024-09-16T16:59:43.289749+0000","last_fullsized":"2024-09-16T16:59:43.289749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786217+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:59:31.786217+0000","last_peered":"2024-09-16T16:59:31.786217+0000","last_clean":"2024-09-16T16:59:31.786217+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:59:31.786217+0000","last_undegraded":"2024-09-16T16:59:31.786217+0000","last_fullsized":"2024-09-16T16:59:31.786217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727506432,"internally_reserved":0,"allocated":483987456,"data_stored":483987456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1202,"ondisk_log_size":1202,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727637504,"internally_reserved":0,"allocated":483856384,"data_stored":483856384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143312,"kb_used_data":143312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154416,"statfs":{"total":53552873472,"available":53406121984,"internally_reserved":0,"allocated":146751488,"data_stored":146751488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83820,"kb_used_data":83820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213908,"statfs":{"total":53552873472,"available":53467041792,"internally_reserved":0,"allocated":85831680,"data_stored":85831680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":122776,"kb_used_data":122776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174952,"statfs":{"total":53552873472,"available":53427150848,"internally_reserved":0,"allocated":125722624,"data_stored":125722624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101828,"kb_used_data":101828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195900,"statfs":{"total":53552873472,"available":53448601600,"internally_reserved":0,"allocated":104271872,"data_stored":104271872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53402013696,"internally_reserved":0,"allocated":150859776,"data_stored":150859776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:11.751 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:00:11.751 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:11.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:11.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:11.890+0000 7f9222311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:11.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:11.904+0000 7f9222311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:12.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T17:00:12.084017+0000 min lat: 0.0216933 max lat: 1.19893 avg lat: 0.15635 2024-09-16T17:00:12.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:12.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 40 16 4098 4082 6.37751 5.125 0.38704 0.15635 2024-09-16T17:00:12.140 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:12.161 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-16T17:00:11.926116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79364659,"num_objects":1206,"num_object_clones":0,"num_object_copies":3618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1283,"num_write_kb":78036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1257,"ondisk_log_size":1257,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":451736,"kb_used_data":451736,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208739176,"statfs":{"total":214211493888,"available":213748916224,"internally_reserved":0,"allocated":462577664,"data_stored":462577664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.128714"},"pg_stats":[{"pgid":"7.f","version":"88'61","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.468452+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T16:59:43.468452+0000","last_peered":"2024-09-16T16:59:43.468452+0000","last_clean":"2024-09-16T16:59:43.468452+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T16:59:43.468452+0000","last_undegraded":"2024-09-16T16:59:43.468452+0000","last_fullsized":"2024-09-16T16:59:43.468452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.405508+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T16:59:43.405508+0000","last_peered":"2024-09-16T16:59:43.405508+0000","last_clean":"2024-09-16T16:59:43.405508+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T16:59:43.405508+0000","last_undegraded":"2024-09-16T16:59:43.405508+0000","last_fullsized":"2024-09-16T16:59:43.405508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.759985+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T16:59:43.759985+0000","last_peered":"2024-09-16T16:59:43.759985+0000","last_clean":"2024-09-16T16:59:43.759985+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T16:59:43.759985+0000","last_undegraded":"2024-09-16T16:59:43.759985+0000","last_fullsized":"2024-09-16T16:59:43.759985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"88'69","reported_seq":81,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.800459+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T16:59:43.800459+0000","last_peered":"2024-09-16T16:59:43.800459+0000","last_clean":"2024-09-16T16:59:43.800459+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T16:59:43.800459+0000","last_undegraded":"2024-09-16T16:59:43.800459+0000","last_fullsized":"2024-09-16T16:59:43.800459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"88'81","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.362917+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T16:59:43.362917+0000","last_peered":"2024-09-16T16:59:43.362917+0000","last_clean":"2024-09-16T16:59:43.362917+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T16:59:43.362917+0000","last_undegraded":"2024-09-16T16:59:43.362917+0000","last_fullsized":"2024-09-16T16:59:43.362917+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"88'85","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.641287+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T16:59:43.641287+0000","last_peered":"2024-09-16T16:59:43.641287+0000","last_clean":"2024-09-16T16:59:43.641287+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T16:59:43.641287+0000","last_undegraded":"2024-09-16T16:59:43.641287+0000","last_fullsized":"2024-09-16T16:59:43.641287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"88'66","reported_seq":78,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.487222+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T16:59:43.487222+0000","last_peered":"2024-09-16T16:59:43.487222+0000","last_clean":"2024-09-16T16:59:43.487222+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T16:59:43.487222+0000","last_undegraded":"2024-09-16T16:59:43.487222+0000","last_fullsized":"2024-09-16T16:59:43.487222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"88'74","reported_seq":86,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.660733+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T16:59:43.660733+0000","last_peered":"2024-09-16T16:59:43.660733+0000","last_clean":"2024-09-16T16:59:43.660733+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T16:59:43.660733+0000","last_undegraded":"2024-09-16T16:59:43.660733+0000","last_fullsized":"2024-09-16T16:59:43.660733+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"88'76","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.656175+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T16:59:43.656175+0000","last_peered":"2024-09-16T16:59:43.656175+0000","last_clean":"2024-09-16T16:59:43.656175+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T16:59:43.656175+0000","last_undegraded":"2024-09-16T16:59:43.656175+0000","last_fullsized":"2024-09-16T16:59:43.656175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.777133+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T16:59:31.777133+0000","last_peered":"2024-09-16T16:59:31.777133+0000","last_clean":"2024-09-16T16:59:31.777133+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T16:59:31.777133+0000","last_undegraded":"2024-09-16T16:59:31.777133+0000","last_fullsized":"2024-09-16T16:59:31.777133+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":233,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784039+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T16:59:31.784039+0000","last_peered":"2024-09-16T16:59:31.784039+0000","last_clean":"2024-09-16T16:59:31.784039+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T16:59:31.784039+0000","last_undegraded":"2024-09-16T16:59:31.784039+0000","last_fullsized":"2024-09-16T16:59:31.784039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"88'77","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.374374+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T16:59:43.374374+0000","last_peered":"2024-09-16T16:59:43.374374+0000","last_clean":"2024-09-16T16:59:43.374374+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T16:59:43.374374+0000","last_undegraded":"2024-09-16T16:59:43.374374+0000","last_fullsized":"2024-09-16T16:59:43.374374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786317+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T16:59:31.786317+0000","last_peered":"2024-09-16T16:59:31.786317+0000","last_clean":"2024-09-16T16:59:31.786317+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T16:59:31.786317+0000","last_undegraded":"2024-09-16T16:59:31.786317+0000","last_fullsized":"2024-09-16T16:59:31.786317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"88'82","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.926402+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T16:59:43.926402+0000","last_peered":"2024-09-16T16:59:43.926402+0000","last_clean":"2024-09-16T16:59:43.926402+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T16:59:43.926402+0000","last_undegraded":"2024-09-16T16:59:43.926402+0000","last_fullsized":"2024-09-16T16:59:43.926402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.778887+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T16:59:31.778887+0000","last_peered":"2024-09-16T16:59:31.778887+0000","last_clean":"2024-09-16T16:59:31.778887+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T16:59:31.778887+0000","last_undegraded":"2024-09-16T16:59:31.778887+0000","last_fullsized":"2024-09-16T16:59:31.778887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"88'79","reported_seq":91,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.230887+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T16:59:43.230887+0000","last_peered":"2024-09-16T16:59:43.230887+0000","last_clean":"2024-09-16T16:59:43.230887+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T16:59:43.230887+0000","last_undegraded":"2024-09-16T16:59:43.230887+0000","last_fullsized":"2024-09-16T16:59:43.230887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":234,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786034+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T16:59:31.786034+0000","last_peered":"2024-09-16T16:59:31.786034+0000","last_clean":"2024-09-16T16:59:31.786034+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T16:59:31.786034+0000","last_undegraded":"2024-09-16T16:59:31.786034+0000","last_fullsized":"2024-09-16T16:59:31.786034+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"88'65","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.593441+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T16:59:43.593441+0000","last_peered":"2024-09-16T16:59:43.593441+0000","last_clean":"2024-09-16T16:59:43.593441+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T16:59:43.593441+0000","last_undegraded":"2024-09-16T16:59:43.593441+0000","last_fullsized":"2024-09-16T16:59:43.593441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786352+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T16:59:31.786352+0000","last_peered":"2024-09-16T16:59:31.786352+0000","last_clean":"2024-09-16T16:59:31.786352+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T16:59:31.786352+0000","last_undegraded":"2024-09-16T16:59:31.786352+0000","last_fullsized":"2024-09-16T16:59:31.786352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"88'88","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.659383+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T16:59:43.659383+0000","last_peered":"2024-09-16T16:59:43.659383+0000","last_clean":"2024-09-16T16:59:43.659383+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T16:59:43.659383+0000","last_undegraded":"2024-09-16T16:59:43.659383+0000","last_fullsized":"2024-09-16T16:59:43.659383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.785763+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T16:59:31.785763+0000","last_peered":"2024-09-16T16:59:31.785763+0000","last_clean":"2024-09-16T16:59:31.785763+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T16:59:31.785763+0000","last_undegraded":"2024-09-16T16:59:31.785763+0000","last_fullsized":"2024-09-16T16:59:31.785763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"88'80","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.816079+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T16:59:43.816079+0000","last_peered":"2024-09-16T16:59:43.816079+0000","last_clean":"2024-09-16T16:59:43.816079+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T16:59:43.816079+0000","last_undegraded":"2024-09-16T16:59:43.816079+0000","last_fullsized":"2024-09-16T16:59:43.816079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.784878+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T16:59:31.784878+0000","last_peered":"2024-09-16T16:59:31.784878+0000","last_clean":"2024-09-16T16:59:31.784878+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T16:59:31.784878+0000","last_undegraded":"2024-09-16T16:59:31.784878+0000","last_fullsized":"2024-09-16T16:59:31.784878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"88'75","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:43.289749+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T16:59:43.289749+0000","last_peered":"2024-09-16T16:59:43.289749+0000","last_clean":"2024-09-16T16:59:43.289749+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T16:59:43.289749+0000","last_undegraded":"2024-09-16T16:59:43.289749+0000","last_fullsized":"2024-09-16T16:59:43.289749+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T16:59:31.786217+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T16:59:31.786217+0000","last_peered":"2024-09-16T16:59:31.786217+0000","last_clean":"2024-09-16T16:59:31.786217+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T16:59:31.786217+0000","last_undegraded":"2024-09-16T16:59:31.786217+0000","last_fullsized":"2024-09-16T16:59:31.786217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727506432,"internally_reserved":0,"allocated":483987456,"data_stored":483987456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1202,"ondisk_log_size":1202,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213727637504,"internally_reserved":0,"allocated":483856384,"data_stored":483856384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":143312,"kb_used_data":143312,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52154416,"statfs":{"total":53552873472,"available":53406121984,"internally_reserved":0,"allocated":146751488,"data_stored":146751488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83820,"kb_used_data":83820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213908,"statfs":{"total":53552873472,"available":53467041792,"internally_reserved":0,"allocated":85831680,"data_stored":85831680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":122776,"kb_used_data":122776,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52174952,"statfs":{"total":53552873472,"available":53427150848,"internally_reserved":0,"allocated":125722624,"data_stored":125722624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101828,"kb_used_data":101828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195900,"statfs":{"total":53552873472,"available":53448601600,"internally_reserved":0,"allocated":104271872,"data_stored":104271872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53402144768,"internally_reserved":0,"allocated":150728704,"data_stored":150728704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53441556480,"internally_reserved":0,"allocated":111316992,"data_stored":111316992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53425311744,"internally_reserved":0,"allocated":127561728,"data_stored":127561728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53458624512,"internally_reserved":0,"allocated":94248960,"data_stored":94248960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53402013696,"internally_reserved":0,"allocated":150859776,"data_stored":150859776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:12.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:12.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:12.584+0000 7fc66ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:12.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:12.591+0000 7fc66ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:13.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 41 16 4202 4186 6.38048 6.5 0.047829 0.156319 2024-09-16T17:00:14.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 42 16 4304 4288 6.38034 6.375 0.191268 0.156401 2024-09-16T17:00:14.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:15.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 43 16 4405 4389 6.37874 6.3125 0.17141 0.156325 2024-09-16T17:00:15.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:15.124+0000 7f11c4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:15.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:15.132+0000 7f11c4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:16.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 44 16 4526 4510 6.40563 7.5625 0.100141 0.155805 2024-09-16T17:00:17.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 45 16 4635 4619 6.41466 6.8125 0.274362 0.155565 2024-09-16T17:00:17.163 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:17.163 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:17.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:17.299+0000 7f7ab2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:17.309+0000 7f7ab2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:17.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:17.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:17.641 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:17.666 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-09-16T17:00:15.927089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280887859,"num_objects":4281,"num_object_clones":0,"num_object_copies":12843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4358,"num_write_kb":274836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1647884,"kb_used_data":1647884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207543028,"statfs":{"total":214211493888,"available":212524060672,"internally_reserved":0,"allocated":1687433216,"data_stored":1687433216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":201523200,"num_objects":3075,"num_object_clones":0,"num_object_copies":9225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3075,"num_write_kb":196800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.123323"},"pg_stats":[{"pgid":"7.f","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.752479+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:13.752479+0000","last_peered":"2024-09-16T17:00:13.752479+0000","last_clean":"2024-09-16T17:00:13.752479+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:13.752479+0000","last_undegraded":"2024-09-16T17:00:13.752479+0000","last_fullsized":"2024-09-16T17:00:13.752479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'250","reported_seq":274,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.532658+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:13.532658+0000","last_peered":"2024-09-16T17:00:13.532658+0000","last_clean":"2024-09-16T17:00:13.532658+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:13.532658+0000","last_undegraded":"2024-09-16T17:00:13.532658+0000","last_fullsized":"2024-09-16T17:00:13.532658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'239","reported_seq":263,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.447007+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:13.447007+0000","last_peered":"2024-09-16T17:00:13.447007+0000","last_clean":"2024-09-16T17:00:13.447007+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:13.447007+0000","last_undegraded":"2024-09-16T17:00:13.447007+0000","last_fullsized":"2024-09-16T17:00:13.447007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'256","reported_seq":280,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.340783+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:13.340783+0000","last_peered":"2024-09-16T17:00:13.340783+0000","last_clean":"2024-09-16T17:00:13.340783+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:13.340783+0000","last_undegraded":"2024-09-16T17:00:13.340783+0000","last_fullsized":"2024-09-16T17:00:13.340783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'267","reported_seq":291,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.503667+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:13.503667+0000","last_peered":"2024-09-16T17:00:13.503667+0000","last_clean":"2024-09-16T17:00:13.503667+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:13.503667+0000","last_undegraded":"2024-09-16T17:00:13.503667+0000","last_fullsized":"2024-09-16T17:00:13.503667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'293","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.545345+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:13.545345+0000","last_peered":"2024-09-16T17:00:13.545345+0000","last_clean":"2024-09-16T17:00:13.545345+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:13.545345+0000","last_undegraded":"2024-09-16T17:00:13.545345+0000","last_fullsized":"2024-09-16T17:00:13.545345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'263","reported_seq":287,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.499986+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:13.499986+0000","last_peered":"2024-09-16T17:00:13.499986+0000","last_clean":"2024-09-16T17:00:13.499986+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:13.499986+0000","last_undegraded":"2024-09-16T17:00:13.499986+0000","last_fullsized":"2024-09-16T17:00:13.499986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'264","reported_seq":288,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.509115+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:13.509115+0000","last_peered":"2024-09-16T17:00:13.509115+0000","last_clean":"2024-09-16T17:00:13.509115+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:13.509115+0000","last_undegraded":"2024-09-16T17:00:13.509115+0000","last_fullsized":"2024-09-16T17:00:13.509115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'241","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.017266+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:13.017266+0000","last_peered":"2024-09-16T17:00:13.017266+0000","last_clean":"2024-09-16T17:00:13.017266+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:13.017266+0000","last_undegraded":"2024-09-16T17:00:13.017266+0000","last_fullsized":"2024-09-16T17:00:13.017266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.637302+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:13.637302+0000","last_peered":"2024-09-16T17:00:13.637302+0000","last_clean":"2024-09-16T17:00:13.637302+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:13.637302+0000","last_undegraded":"2024-09-16T17:00:13.637302+0000","last_fullsized":"2024-09-16T17:00:13.637302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'276","reported_seq":300,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.570601+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:13.570601+0000","last_peered":"2024-09-16T17:00:13.570601+0000","last_clean":"2024-09-16T17:00:13.570601+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:13.570601+0000","last_undegraded":"2024-09-16T17:00:13.570601+0000","last_fullsized":"2024-09-16T17:00:13.570601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4277,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519236,"kb_used_data":519236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51778492,"statfs":{"total":53552873472,"available":53021175808,"internally_reserved":0,"allocated":531697664,"data_stored":531697664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":449432,"kb_used_data":449432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51848296,"statfs":{"total":53552873472,"available":53092655104,"internally_reserved":0,"allocated":460218368,"data_stored":460218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369532,"kb_used_data":369532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928196,"statfs":{"total":53552873472,"available":53174472704,"internally_reserved":0,"allocated":378400768,"data_stored":378400768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:17.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:17.745+0000 7f3433391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:17.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:17.766+0000 7f3433391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:18.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 46 16 4740 4724 6.41786 6.5625 0.275263 0.155416 2024-09-16T17:00:19.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 47 16 4860 4844 6.44086 7.5 0.0790519 0.154929 2024-09-16T17:00:20.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 48 16 4975 4959 6.45641 7.1875 0.122463 0.154633 2024-09-16T17:00:20.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:20.375+0000 7fa4616d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:20.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:20.384+0000 7fa4616d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.084 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 49 16 5086 5070 6.46621 6.9375 0.248988 0.154359 2024-09-16T17:00:22.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 50 16 5197 5181 6.47562 6.9375 0.113921 0.154197 2024-09-16T17:00:22.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:22.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:22.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:22.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:22.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:22.740+0000 7f19878fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:22.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:22.748+0000 7f19878fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:22.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:22.797+0000 7f25cc0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:22.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:22.807+0000 7f25cc0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:23.054 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:23.055 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:23.078 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-16T17:00:21.928467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280887859,"num_objects":4281,"num_object_clones":0,"num_object_copies":12843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4358,"num_write_kb":274836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1647884,"kb_used_data":1647884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207543028,"statfs":{"total":214211493888,"available":212524060672,"internally_reserved":0,"allocated":1687433216,"data_stored":1687433216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":201523200,"num_objects":3075,"num_object_clones":0,"num_object_copies":9225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3075,"num_write_kb":196800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.109357"},"pg_stats":[{"pgid":"7.f","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.752479+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:13.752479+0000","last_peered":"2024-09-16T17:00:13.752479+0000","last_clean":"2024-09-16T17:00:13.752479+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:13.752479+0000","last_undegraded":"2024-09-16T17:00:13.752479+0000","last_fullsized":"2024-09-16T17:00:13.752479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'250","reported_seq":274,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.532658+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:13.532658+0000","last_peered":"2024-09-16T17:00:13.532658+0000","last_clean":"2024-09-16T17:00:13.532658+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:13.532658+0000","last_undegraded":"2024-09-16T17:00:13.532658+0000","last_fullsized":"2024-09-16T17:00:13.532658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'239","reported_seq":263,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.447007+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:13.447007+0000","last_peered":"2024-09-16T17:00:13.447007+0000","last_clean":"2024-09-16T17:00:13.447007+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:13.447007+0000","last_undegraded":"2024-09-16T17:00:13.447007+0000","last_fullsized":"2024-09-16T17:00:13.447007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'256","reported_seq":280,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.340783+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:13.340783+0000","last_peered":"2024-09-16T17:00:13.340783+0000","last_clean":"2024-09-16T17:00:13.340783+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:13.340783+0000","last_undegraded":"2024-09-16T17:00:13.340783+0000","last_fullsized":"2024-09-16T17:00:13.340783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'267","reported_seq":291,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.503667+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:13.503667+0000","last_peered":"2024-09-16T17:00:13.503667+0000","last_clean":"2024-09-16T17:00:13.503667+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:13.503667+0000","last_undegraded":"2024-09-16T17:00:13.503667+0000","last_fullsized":"2024-09-16T17:00:13.503667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'293","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.545345+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:13.545345+0000","last_peered":"2024-09-16T17:00:13.545345+0000","last_clean":"2024-09-16T17:00:13.545345+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:13.545345+0000","last_undegraded":"2024-09-16T17:00:13.545345+0000","last_fullsized":"2024-09-16T17:00:13.545345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'263","reported_seq":287,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.499986+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:13.499986+0000","last_peered":"2024-09-16T17:00:13.499986+0000","last_clean":"2024-09-16T17:00:13.499986+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:13.499986+0000","last_undegraded":"2024-09-16T17:00:13.499986+0000","last_fullsized":"2024-09-16T17:00:13.499986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'264","reported_seq":288,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.509115+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:13.509115+0000","last_peered":"2024-09-16T17:00:13.509115+0000","last_clean":"2024-09-16T17:00:13.509115+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:13.509115+0000","last_undegraded":"2024-09-16T17:00:13.509115+0000","last_fullsized":"2024-09-16T17:00:13.509115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'241","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.017266+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:13.017266+0000","last_peered":"2024-09-16T17:00:13.017266+0000","last_clean":"2024-09-16T17:00:13.017266+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:13.017266+0000","last_undegraded":"2024-09-16T17:00:13.017266+0000","last_fullsized":"2024-09-16T17:00:13.017266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.637302+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:13.637302+0000","last_peered":"2024-09-16T17:00:13.637302+0000","last_clean":"2024-09-16T17:00:13.637302+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:13.637302+0000","last_undegraded":"2024-09-16T17:00:13.637302+0000","last_fullsized":"2024-09-16T17:00:13.637302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'276","reported_seq":300,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.570601+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:13.570601+0000","last_peered":"2024-09-16T17:00:13.570601+0000","last_clean":"2024-09-16T17:00:13.570601+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:13.570601+0000","last_undegraded":"2024-09-16T17:00:13.570601+0000","last_fullsized":"2024-09-16T17:00:13.570601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4277,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519236,"kb_used_data":519236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51778492,"statfs":{"total":53552873472,"available":53021175808,"internally_reserved":0,"allocated":531697664,"data_stored":531697664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":449432,"kb_used_data":449432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51848296,"statfs":{"total":53552873472,"available":53092655104,"internally_reserved":0,"allocated":460218368,"data_stored":460218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369532,"kb_used_data":369532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928196,"statfs":{"total":53552873472,"available":53174472704,"internally_reserved":0,"allocated":378400768,"data_stored":378400768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:23.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 51 16 5286 5270 6.45771 5.5625 0.0774029 0.15439 2024-09-16T17:00:24.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 52 16 5396 5380 6.46572 6.875 0.184034 0.154315 2024-09-16T17:00:25.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 53 16 5498 5482 6.464 6.375 0.182219 0.154364 2024-09-16T17:00:25.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:25.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:25.264+0000 7f1624108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:25.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:25.274+0000 7f1624108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:26.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 54 16 5603 5587 6.46581 6.5625 0.0639869 0.154349 2024-09-16T17:00:27.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 55 16 5706 5690 6.46528 6.4375 0.178547 0.154332 2024-09-16T17:00:27.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:27.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:27.782+0000 7fc6b5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:27.788+0000 7fc6b5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:28.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:28.081 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:28.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:28.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 56 16 5815 5799 6.47147 6.8125 0.120711 0.154283 2024-09-16T17:00:28.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:28.221+0000 7f7681591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:28.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:28.230+0000 7f7681591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:28.522 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:28.523 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:28.540 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-09-16T17:00:27.929812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280887859,"num_objects":4281,"num_object_clones":0,"num_object_copies":12843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4358,"num_write_kb":274836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1647884,"kb_used_data":1647884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207543028,"statfs":{"total":214211493888,"available":212524060672,"internally_reserved":0,"allocated":1687433216,"data_stored":1687433216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002723"},"pg_stats":[{"pgid":"7.f","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.752479+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:13.752479+0000","last_peered":"2024-09-16T17:00:13.752479+0000","last_clean":"2024-09-16T17:00:13.752479+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:13.752479+0000","last_undegraded":"2024-09-16T17:00:13.752479+0000","last_fullsized":"2024-09-16T17:00:13.752479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'250","reported_seq":274,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.532658+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:13.532658+0000","last_peered":"2024-09-16T17:00:13.532658+0000","last_clean":"2024-09-16T17:00:13.532658+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:13.532658+0000","last_undegraded":"2024-09-16T17:00:13.532658+0000","last_fullsized":"2024-09-16T17:00:13.532658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'239","reported_seq":263,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.447007+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:13.447007+0000","last_peered":"2024-09-16T17:00:13.447007+0000","last_clean":"2024-09-16T17:00:13.447007+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:13.447007+0000","last_undegraded":"2024-09-16T17:00:13.447007+0000","last_fullsized":"2024-09-16T17:00:13.447007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'256","reported_seq":280,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.340783+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:13.340783+0000","last_peered":"2024-09-16T17:00:13.340783+0000","last_clean":"2024-09-16T17:00:13.340783+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:13.340783+0000","last_undegraded":"2024-09-16T17:00:13.340783+0000","last_fullsized":"2024-09-16T17:00:13.340783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'267","reported_seq":291,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.503667+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:13.503667+0000","last_peered":"2024-09-16T17:00:13.503667+0000","last_clean":"2024-09-16T17:00:13.503667+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:13.503667+0000","last_undegraded":"2024-09-16T17:00:13.503667+0000","last_fullsized":"2024-09-16T17:00:13.503667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'293","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.545345+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:13.545345+0000","last_peered":"2024-09-16T17:00:13.545345+0000","last_clean":"2024-09-16T17:00:13.545345+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:13.545345+0000","last_undegraded":"2024-09-16T17:00:13.545345+0000","last_fullsized":"2024-09-16T17:00:13.545345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'263","reported_seq":287,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.499986+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:13.499986+0000","last_peered":"2024-09-16T17:00:13.499986+0000","last_clean":"2024-09-16T17:00:13.499986+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:13.499986+0000","last_undegraded":"2024-09-16T17:00:13.499986+0000","last_fullsized":"2024-09-16T17:00:13.499986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'264","reported_seq":288,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.509115+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:13.509115+0000","last_peered":"2024-09-16T17:00:13.509115+0000","last_clean":"2024-09-16T17:00:13.509115+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:13.509115+0000","last_undegraded":"2024-09-16T17:00:13.509115+0000","last_fullsized":"2024-09-16T17:00:13.509115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'241","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.017266+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:13.017266+0000","last_peered":"2024-09-16T17:00:13.017266+0000","last_clean":"2024-09-16T17:00:13.017266+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:13.017266+0000","last_undegraded":"2024-09-16T17:00:13.017266+0000","last_fullsized":"2024-09-16T17:00:13.017266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.637302+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:13.637302+0000","last_peered":"2024-09-16T17:00:13.637302+0000","last_clean":"2024-09-16T17:00:13.637302+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:13.637302+0000","last_undegraded":"2024-09-16T17:00:13.637302+0000","last_fullsized":"2024-09-16T17:00:13.637302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'276","reported_seq":300,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.570601+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:13.570601+0000","last_peered":"2024-09-16T17:00:13.570601+0000","last_clean":"2024-09-16T17:00:13.570601+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:13.570601+0000","last_undegraded":"2024-09-16T17:00:13.570601+0000","last_fullsized":"2024-09-16T17:00:13.570601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4277,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519236,"kb_used_data":519236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51778492,"statfs":{"total":53552873472,"available":53021175808,"internally_reserved":0,"allocated":531697664,"data_stored":531697664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":449432,"kb_used_data":449432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51848296,"statfs":{"total":53552873472,"available":53092655104,"internally_reserved":0,"allocated":460218368,"data_stored":460218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369532,"kb_used_data":369532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928196,"statfs":{"total":53552873472,"available":53174472704,"internally_reserved":0,"allocated":378400768,"data_stored":378400768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:29.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 57 16 5920 5904 6.47306 6.5625 0.247149 0.154266 2024-09-16T17:00:30.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 58 16 6036 6020 6.48644 7.25 0.148812 0.153912 2024-09-16T17:00:30.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:30.357+0000 7fbf84cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:30.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:30.368+0000 7fbf84cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:31.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 59 16 6142 6126 6.48878 6.625 0.0759007 0.153865 2024-09-16T17:00:32.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T17:00:32.085956+0000 min lat: 0.0216933 max lat: 1.19893 avg lat: 0.154095 2024-09-16T17:00:32.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:32.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 60 16 6238 6222 6.48062 6 0.184678 0.154095 2024-09-16T17:00:32.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:32.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:32.924+0000 7f28466fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:32.933+0000 7f28466fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 61 16 6351 6335 6.49015 7.0625 0.142182 0.153903 2024-09-16T17:00:33.542 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:33.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:33.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:33.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:33.703+0000 7f04d7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:33.713+0000 7f04d7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:34.055 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:34.056 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:34.080 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-16T17:00:33.931187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280887859,"num_objects":4281,"num_object_clones":0,"num_object_copies":12843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4358,"num_write_kb":274836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1647884,"kb_used_data":1647884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207543028,"statfs":{"total":214211493888,"available":212524060672,"internally_reserved":0,"allocated":1687433216,"data_stored":1687433216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002719"},"pg_stats":[{"pgid":"7.f","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.752479+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:13.752479+0000","last_peered":"2024-09-16T17:00:13.752479+0000","last_clean":"2024-09-16T17:00:13.752479+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:13.752479+0000","last_undegraded":"2024-09-16T17:00:13.752479+0000","last_fullsized":"2024-09-16T17:00:13.752479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'250","reported_seq":274,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.532658+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:13.532658+0000","last_peered":"2024-09-16T17:00:13.532658+0000","last_clean":"2024-09-16T17:00:13.532658+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:13.532658+0000","last_undegraded":"2024-09-16T17:00:13.532658+0000","last_fullsized":"2024-09-16T17:00:13.532658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'239","reported_seq":263,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.447007+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:13.447007+0000","last_peered":"2024-09-16T17:00:13.447007+0000","last_clean":"2024-09-16T17:00:13.447007+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:13.447007+0000","last_undegraded":"2024-09-16T17:00:13.447007+0000","last_fullsized":"2024-09-16T17:00:13.447007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'256","reported_seq":280,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.340783+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:13.340783+0000","last_peered":"2024-09-16T17:00:13.340783+0000","last_clean":"2024-09-16T17:00:13.340783+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:13.340783+0000","last_undegraded":"2024-09-16T17:00:13.340783+0000","last_fullsized":"2024-09-16T17:00:13.340783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'267","reported_seq":291,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.503667+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:13.503667+0000","last_peered":"2024-09-16T17:00:13.503667+0000","last_clean":"2024-09-16T17:00:13.503667+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:13.503667+0000","last_undegraded":"2024-09-16T17:00:13.503667+0000","last_fullsized":"2024-09-16T17:00:13.503667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'293","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.545345+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:13.545345+0000","last_peered":"2024-09-16T17:00:13.545345+0000","last_clean":"2024-09-16T17:00:13.545345+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:13.545345+0000","last_undegraded":"2024-09-16T17:00:13.545345+0000","last_fullsized":"2024-09-16T17:00:13.545345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'263","reported_seq":287,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.499986+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:13.499986+0000","last_peered":"2024-09-16T17:00:13.499986+0000","last_clean":"2024-09-16T17:00:13.499986+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:13.499986+0000","last_undegraded":"2024-09-16T17:00:13.499986+0000","last_fullsized":"2024-09-16T17:00:13.499986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'264","reported_seq":288,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.509115+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:13.509115+0000","last_peered":"2024-09-16T17:00:13.509115+0000","last_clean":"2024-09-16T17:00:13.509115+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:13.509115+0000","last_undegraded":"2024-09-16T17:00:13.509115+0000","last_fullsized":"2024-09-16T17:00:13.509115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'241","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.017266+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:13.017266+0000","last_peered":"2024-09-16T17:00:13.017266+0000","last_clean":"2024-09-16T17:00:13.017266+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:13.017266+0000","last_undegraded":"2024-09-16T17:00:13.017266+0000","last_fullsized":"2024-09-16T17:00:13.017266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.637302+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:13.637302+0000","last_peered":"2024-09-16T17:00:13.637302+0000","last_clean":"2024-09-16T17:00:13.637302+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:13.637302+0000","last_undegraded":"2024-09-16T17:00:13.637302+0000","last_fullsized":"2024-09-16T17:00:13.637302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'276","reported_seq":300,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.570601+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:13.570601+0000","last_peered":"2024-09-16T17:00:13.570601+0000","last_clean":"2024-09-16T17:00:13.570601+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:13.570601+0000","last_undegraded":"2024-09-16T17:00:13.570601+0000","last_fullsized":"2024-09-16T17:00:13.570601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4277,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519236,"kb_used_data":519236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51778492,"statfs":{"total":53552873472,"available":53021175808,"internally_reserved":0,"allocated":531697664,"data_stored":531697664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":449432,"kb_used_data":449432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51848296,"statfs":{"total":53552873472,"available":53092655104,"internally_reserved":0,"allocated":460218368,"data_stored":460218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369532,"kb_used_data":369532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928196,"statfs":{"total":53552873472,"available":53174472704,"internally_reserved":0,"allocated":378400768,"data_stored":378400768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:34.085 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 62 16 6445 6429 6.48022 5.875 0.08772 0.153931 2024-09-16T17:00:35.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 63 16 6558 6542 6.48945 7.0625 0.0897029 0.153889 2024-09-16T17:00:35.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:35.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:35.609+0000 7f268baa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:35.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:35.620+0000 7f268baa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:36.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 64 16 6664 6648 6.49156 6.625 0.0882915 0.153812 2024-09-16T17:00:37.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 65 16 6770 6754 6.4936 6.625 0.252944 0.153767 2024-09-16T17:00:38.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:38.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 66 16 6881 6865 6.50027 6.9375 0.0945159 0.153677 2024-09-16T17:00:38.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:38.221+0000 7f3027991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:38.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:38.231+0000 7f3027991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:39.083 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:39.083 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:39.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:39.086 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 67 16 6984 6968 6.49932 6.4375 0.201387 0.153681 2024-09-16T17:00:39.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:39.257+0000 7f51eacbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:39.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:39.272+0000 7f51eacbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:39.592 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:39.592 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:39.618 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2024-09-16T17:00:37.932034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280887859,"num_objects":4281,"num_object_clones":0,"num_object_copies":12843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4358,"num_write_kb":274836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1647884,"kb_used_data":1647884,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207543028,"statfs":{"total":214211493888,"available":212524060672,"internally_reserved":0,"allocated":1687433216,"data_stored":1687433216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002669"},"pg_stats":[{"pgid":"7.f","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.752479+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:13.752479+0000","last_peered":"2024-09-16T17:00:13.752479+0000","last_clean":"2024-09-16T17:00:13.752479+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:13.752479+0000","last_undegraded":"2024-09-16T17:00:13.752479+0000","last_fullsized":"2024-09-16T17:00:13.752479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'250","reported_seq":274,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.532658+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:13.532658+0000","last_peered":"2024-09-16T17:00:13.532658+0000","last_clean":"2024-09-16T17:00:13.532658+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:13.532658+0000","last_undegraded":"2024-09-16T17:00:13.532658+0000","last_fullsized":"2024-09-16T17:00:13.532658+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'239","reported_seq":263,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.447007+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:13.447007+0000","last_peered":"2024-09-16T17:00:13.447007+0000","last_clean":"2024-09-16T17:00:13.447007+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:13.447007+0000","last_undegraded":"2024-09-16T17:00:13.447007+0000","last_fullsized":"2024-09-16T17:00:13.447007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'256","reported_seq":280,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.340783+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:13.340783+0000","last_peered":"2024-09-16T17:00:13.340783+0000","last_clean":"2024-09-16T17:00:13.340783+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:13.340783+0000","last_undegraded":"2024-09-16T17:00:13.340783+0000","last_fullsized":"2024-09-16T17:00:13.340783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'267","reported_seq":291,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.503667+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:13.503667+0000","last_peered":"2024-09-16T17:00:13.503667+0000","last_clean":"2024-09-16T17:00:13.503667+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:13.503667+0000","last_undegraded":"2024-09-16T17:00:13.503667+0000","last_fullsized":"2024-09-16T17:00:13.503667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'293","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.545345+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:13.545345+0000","last_peered":"2024-09-16T17:00:13.545345+0000","last_clean":"2024-09-16T17:00:13.545345+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:13.545345+0000","last_undegraded":"2024-09-16T17:00:13.545345+0000","last_fullsized":"2024-09-16T17:00:13.545345+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'263","reported_seq":287,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.499986+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:13.499986+0000","last_peered":"2024-09-16T17:00:13.499986+0000","last_clean":"2024-09-16T17:00:13.499986+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:13.499986+0000","last_undegraded":"2024-09-16T17:00:13.499986+0000","last_fullsized":"2024-09-16T17:00:13.499986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'264","reported_seq":288,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.509115+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:13.509115+0000","last_peered":"2024-09-16T17:00:13.509115+0000","last_clean":"2024-09-16T17:00:13.509115+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:13.509115+0000","last_undegraded":"2024-09-16T17:00:13.509115+0000","last_fullsized":"2024-09-16T17:00:13.509115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'241","reported_seq":265,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.017266+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:13.017266+0000","last_peered":"2024-09-16T17:00:13.017266+0000","last_clean":"2024-09-16T17:00:13.017266+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:13.017266+0000","last_undegraded":"2024-09-16T17:00:13.017266+0000","last_fullsized":"2024-09-16T17:00:13.017266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":241,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'269","reported_seq":293,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.637302+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:13.637302+0000","last_peered":"2024-09-16T17:00:13.637302+0000","last_clean":"2024-09-16T17:00:13.637302+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:13.637302+0000","last_undegraded":"2024-09-16T17:00:13.637302+0000","last_fullsized":"2024-09-16T17:00:13.637302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'276","reported_seq":300,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.570601+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:13.570601+0000","last_peered":"2024-09-16T17:00:13.570601+0000","last_clean":"2024-09-16T17:00:13.570601+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:13.570601+0000","last_undegraded":"2024-09-16T17:00:13.570601+0000","last_fullsized":"2024-09-16T17:00:13.570601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":280297472,"num_objects":4277,"num_object_clones":0,"num_object_copies":12831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4277,"num_write_kb":273728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4277,"ondisk_log_size":4277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212505837568,"internally_reserved":0,"allocated":1705656320,"data_stored":1705656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":519236,"kb_used_data":519236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51778492,"statfs":{"total":53552873472,"available":53021175808,"internally_reserved":0,"allocated":531697664,"data_stored":531697664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":449432,"kb_used_data":449432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51848296,"statfs":{"total":53552873472,"available":53092655104,"internally_reserved":0,"allocated":460218368,"data_stored":460218368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":369532,"kb_used_data":369532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51928196,"statfs":{"total":53552873472,"available":53174472704,"internally_reserved":0,"allocated":378400768,"data_stored":378400768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53168590848,"internally_reserved":0,"allocated":384282624,"data_stored":384282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53090934784,"internally_reserved":0,"allocated":461938688,"data_stored":461938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53018152960,"internally_reserved":0,"allocated":534720512,"data_stored":534720512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:40.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 68 16 7095 7079 6.50575 6.9375 0.118878 0.153576 2024-09-16T17:00:40.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:40.795+0000 7f071848e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:40.803+0000 7f071848e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:41.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 69 16 7205 7189 6.5111 6.875 0.184758 0.153415 2024-09-16T17:00:42.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 70 16 7314 7298 6.51539 6.8125 0.0728806 0.153287 2024-09-16T17:00:43.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 71 16 7431 7415 6.52661 7.3125 0.107751 0.153006 2024-09-16T17:00:43.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:43.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:43.418+0000 7fca37d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:43.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:43.428+0000 7fca37d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:44.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 72 16 7536 7520 6.5271 6.5625 0.106212 0.152988 2024-09-16T17:00:44.620 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:44.620 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:44.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:44.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:44.759+0000 7f0410991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:44.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:44.771+0000 7f0410991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:45.043 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:45.043 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:45.063 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":503,"stamp":"2024-09-16T17:00:43.933357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":425067059,"num_objects":6481,"num_object_clones":0,"num_object_copies":19443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6558,"num_write_kb":415636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6532,"ondisk_log_size":6532,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2659176,"kb_used_data":2659176,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206531736,"statfs":{"total":214211493888,"available":211488497664,"internally_reserved":0,"allocated":2722996224,"data_stored":2722996224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":144179200,"num_objects":2200,"num_object_clones":0,"num_object_copies":6600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2200,"num_write_kb":140800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002671"},"pg_stats":[{"pgid":"7.f","version":"92'495","reported_seq":519,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.647923+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:43.647923+0000","last_peered":"2024-09-16T17:00:43.647923+0000","last_clean":"2024-09-16T17:00:43.647923+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:43.647923+0000","last_undegraded":"2024-09-16T17:00:43.647923+0000","last_fullsized":"2024-09-16T17:00:43.647923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.504244+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:43.504244+0000","last_peered":"2024-09-16T17:00:43.504244+0000","last_clean":"2024-09-16T17:00:43.504244+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:43.504244+0000","last_undegraded":"2024-09-16T17:00:43.504244+0000","last_fullsized":"2024-09-16T17:00:43.504244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'279","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.734777+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:13.734777+0000","last_peered":"2024-09-16T17:00:13.734777+0000","last_clean":"2024-09-16T17:00:13.734777+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:13.734777+0000","last_undegraded":"2024-09-16T17:00:13.734777+0000","last_fullsized":"2024-09-16T17:00:13.734777+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'270","reported_seq":294,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.732088+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:13.732088+0000","last_peered":"2024-09-16T17:00:13.732088+0000","last_clean":"2024-09-16T17:00:13.732088+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:13.732088+0000","last_undegraded":"2024-09-16T17:00:13.732088+0000","last_fullsized":"2024-09-16T17:00:13.732088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.827262+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:43.827262+0000","last_peered":"2024-09-16T17:00:43.827262+0000","last_clean":"2024-09-16T17:00:43.827262+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:43.827262+0000","last_undegraded":"2024-09-16T17:00:43.827262+0000","last_fullsized":"2024-09-16T17:00:43.827262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'470","reported_seq":494,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.669948+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:43.669948+0000","last_peered":"2024-09-16T17:00:43.669948+0000","last_clean":"2024-09-16T17:00:43.669948+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:43.669948+0000","last_undegraded":"2024-09-16T17:00:43.669948+0000","last_fullsized":"2024-09-16T17:00:43.669948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'257","reported_seq":281,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.507071+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:13.507071+0000","last_peered":"2024-09-16T17:00:13.507071+0000","last_clean":"2024-09-16T17:00:13.507071+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:13.507071+0000","last_undegraded":"2024-09-16T17:00:13.507071+0000","last_fullsized":"2024-09-16T17:00:13.507071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'439","reported_seq":463,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.480154+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:43.480154+0000","last_peered":"2024-09-16T17:00:43.480154+0000","last_clean":"2024-09-16T17:00:43.480154+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:43.480154+0000","last_undegraded":"2024-09-16T17:00:43.480154+0000","last_fullsized":"2024-09-16T17:00:43.480154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'473","reported_seq":497,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.622567+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:43.622567+0000","last_peered":"2024-09-16T17:00:43.622567+0000","last_clean":"2024-09-16T17:00:43.622567+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:43.622567+0000","last_undegraded":"2024-09-16T17:00:43.622567+0000","last_fullsized":"2024-09-16T17:00:43.622567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'462","reported_seq":486,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.529264+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:43.529264+0000","last_peered":"2024-09-16T17:00:43.529264+0000","last_clean":"2024-09-16T17:00:43.529264+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:43.529264+0000","last_undegraded":"2024-09-16T17:00:43.529264+0000","last_fullsized":"2024-09-16T17:00:43.529264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'268","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.708661+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:13.708661+0000","last_peered":"2024-09-16T17:00:13.708661+0000","last_clean":"2024-09-16T17:00:13.708661+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:13.708661+0000","last_undegraded":"2024-09-16T17:00:13.708661+0000","last_fullsized":"2024-09-16T17:00:13.708661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.367576+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:43.367576+0000","last_peered":"2024-09-16T17:00:43.367576+0000","last_clean":"2024-09-16T17:00:43.367576+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:43.367576+0000","last_undegraded":"2024-09-16T17:00:43.367576+0000","last_fullsized":"2024-09-16T17:00:43.367576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.444814+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:43.444814+0000","last_peered":"2024-09-16T17:00:43.444814+0000","last_clean":"2024-09-16T17:00:43.444814+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:43.444814+0000","last_undegraded":"2024-09-16T17:00:43.444814+0000","last_fullsized":"2024-09-16T17:00:43.444814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'316","reported_seq":340,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:13.871975+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:13.871975+0000","last_peered":"2024-09-16T17:00:13.871975+0000","last_clean":"2024-09-16T17:00:13.871975+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:13.871975+0000","last_undegraded":"2024-09-16T17:00:13.871975+0000","last_fullsized":"2024-09-16T17:00:13.871975+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'455","reported_seq":479,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.721969+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:43.721969+0000","last_peered":"2024-09-16T17:00:43.721969+0000","last_clean":"2024-09-16T17:00:43.721969+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:43.721969+0000","last_undegraded":"2024-09-16T17:00:43.721969+0000","last_fullsized":"2024-09-16T17:00:43.721969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'467","reported_seq":491,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.547270+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:43.547270+0000","last_peered":"2024-09-16T17:00:43.547270+0000","last_clean":"2024-09-16T17:00:43.547270+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:43.547270+0000","last_undegraded":"2024-09-16T17:00:43.547270+0000","last_fullsized":"2024-09-16T17:00:43.547270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":424476672,"num_objects":6477,"num_object_clones":0,"num_object_copies":19431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6477,"num_write_kb":414528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211470598144,"internally_reserved":0,"allocated":2740895744,"data_stored":2740895744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211470729216,"internally_reserved":0,"allocated":2740764672,"data_stored":2740764672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":907440,"kb_used_data":907440,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51390288,"statfs":{"total":53552873472,"available":52623654912,"internally_reserved":0,"allocated":929218560,"data_stored":929218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":309684,"kb_used_data":309684,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51988044,"statfs":{"total":53552873472,"available":53235757056,"internally_reserved":0,"allocated":317116416,"data_stored":317116416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":786564,"kb_used_data":786564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51511164,"statfs":{"total":53552873472,"available":52747431936,"internally_reserved":0,"allocated":805441536,"data_stored":805441536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":655488,"kb_used_data":655488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51642240,"statfs":{"total":53552873472,"available":52881653760,"internally_reserved":0,"allocated":671219712,"data_stored":671219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52745723904,"internally_reserved":0,"allocated":807149568,"data_stored":807149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52745592832,"internally_reserved":0,"allocated":807280640,"data_stored":807280640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53228158976,"internally_reserved":0,"allocated":324714496,"data_stored":324714496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:45.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 73 16 7648 7632 6.53357 7 0.499614 0.152874 2024-09-16T17:00:45.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:46.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:46.019+0000 7f9d66646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:46.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:46.025+0000 7f9d66646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:46.087 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 74 16 7759 7743 6.53901 6.9375 0.167485 0.152774 2024-09-16T17:00:47.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 75 16 7859 7843 6.53515 6.25 0.0507902 0.15275 2024-09-16T17:00:48.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 76 16 7973 7957 6.54291 7.125 0.114124 0.152635 2024-09-16T17:00:48.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:48.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:48.661+0000 7f284a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:48.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:48.668+0000 7f284a711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:49.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 77 16 8080 8064 6.54478 6.6875 0.32324 0.152565 2024-09-16T17:00:50.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:50.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:50.066 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:00:50.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:00:50.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 78 16 8189 8173 6.5482 6.8125 0.116736 0.15251 2024-09-16T17:00:50.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.220+0000 7f3dc7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.231+0000 7f3dc7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:00:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:00:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:00:50.258 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:00:50.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:50.262 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:50.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:00:50.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.450+0000 7f57dc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.462+0000 7f57dc511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:00:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:00:50.498 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:00:50.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:50.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:50.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:00:50.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.646+0000 7f8ecfc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.660+0000 7f8ecfc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:00:50.794 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:00:50.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:50.799 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:50.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:00:50.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.960+0000 7fae08c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:50.973+0000 7fae08c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:51.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 79 16 8297 8281 6.55075 6.75 0.101346 0.15248 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:00:51.113 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:00:51.116 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:51.117 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:51.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:51.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:51.310+0000 7f9b68511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:51.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:51.317+0000 7f9b68511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:52.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:2024-09-16T17:00:52.088414+0000 min lat: 0.0216933 max lat: 1.19893 avg lat: 0.15253 2024-09-16T17:00:52.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:52.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 80 16 8397 8381 6.54698 6.25 0.0907177 0.15253 2024-09-16T17:00:53.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 81 16 8495 8479 6.54176 6.125 0.144277 0.152562 2024-09-16T17:00:53.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:53.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:53.878+0000 7f36eeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:53.886+0000 7f36eeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:54.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 82 16 8599 8583 6.54125 6.5 0.129657 0.152668 2024-09-16T17:00:55.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 83 16 8693 8677 6.53321 5.875 0.174979 0.152874 2024-09-16T17:00:56.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 84 16 8798 8782 6.53356 6.5625 0.197011 0.152898 2024-09-16T17:00:56.118 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:56.118 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:56.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:56.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:56.254+0000 7ff67f308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:56.265+0000 7ff67f308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:56.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:56.509+0000 7f526b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:56.518+0000 7f526b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:00:56.550 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:00:56.566 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-16T17:00:55.936066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":492831283,"num_objects":7515,"num_object_clones":0,"num_object_copies":22545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7592,"num_write_kb":481812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7566,"ondisk_log_size":7566,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2899576,"kb_used_data":2899576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206291336,"statfs":{"total":214211493888,"available":211242328064,"internally_reserved":0,"allocated":2969165824,"data_stored":2969165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":3102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002709"},"pg_stats":[{"pgid":"7.f","version":"92'495","reported_seq":519,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.647923+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:43.647923+0000","last_peered":"2024-09-16T17:00:43.647923+0000","last_clean":"2024-09-16T17:00:43.647923+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:43.647923+0000","last_undegraded":"2024-09-16T17:00:43.647923+0000","last_fullsized":"2024-09-16T17:00:43.647923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.504244+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:43.504244+0000","last_peered":"2024-09-16T17:00:43.504244+0000","last_clean":"2024-09-16T17:00:43.504244+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:43.504244+0000","last_undegraded":"2024-09-16T17:00:43.504244+0000","last_fullsized":"2024-09-16T17:00:43.504244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'483","reported_seq":507,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.609770+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:43.609770+0000","last_peered":"2024-09-16T17:00:43.609770+0000","last_clean":"2024-09-16T17:00:43.609770+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:43.609770+0000","last_undegraded":"2024-09-16T17:00:43.609770+0000","last_fullsized":"2024-09-16T17:00:43.609770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":30912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'457","reported_seq":481,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.575760+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:43.575760+0000","last_peered":"2024-09-16T17:00:43.575760+0000","last_clean":"2024-09-16T17:00:43.575760+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:43.575760+0000","last_undegraded":"2024-09-16T17:00:43.575760+0000","last_fullsized":"2024-09-16T17:00:43.575760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.827262+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:43.827262+0000","last_peered":"2024-09-16T17:00:43.827262+0000","last_clean":"2024-09-16T17:00:43.827262+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:43.827262+0000","last_undegraded":"2024-09-16T17:00:43.827262+0000","last_fullsized":"2024-09-16T17:00:43.827262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'470","reported_seq":494,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.669948+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:43.669948+0000","last_peered":"2024-09-16T17:00:43.669948+0000","last_clean":"2024-09-16T17:00:43.669948+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:43.669948+0000","last_undegraded":"2024-09-16T17:00:43.669948+0000","last_fullsized":"2024-09-16T17:00:43.669948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'486","reported_seq":510,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.715505+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:43.715505+0000","last_peered":"2024-09-16T17:00:43.715505+0000","last_clean":"2024-09-16T17:00:43.715505+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:43.715505+0000","last_undegraded":"2024-09-16T17:00:43.715505+0000","last_fullsized":"2024-09-16T17:00:43.715505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":31104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'439","reported_seq":463,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.480154+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:43.480154+0000","last_peered":"2024-09-16T17:00:43.480154+0000","last_clean":"2024-09-16T17:00:43.480154+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:43.480154+0000","last_undegraded":"2024-09-16T17:00:43.480154+0000","last_fullsized":"2024-09-16T17:00:43.480154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'473","reported_seq":497,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.622567+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:43.622567+0000","last_peered":"2024-09-16T17:00:43.622567+0000","last_clean":"2024-09-16T17:00:43.622567+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:43.622567+0000","last_undegraded":"2024-09-16T17:00:43.622567+0000","last_fullsized":"2024-09-16T17:00:43.622567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'462","reported_seq":486,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.529264+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:43.529264+0000","last_peered":"2024-09-16T17:00:43.529264+0000","last_clean":"2024-09-16T17:00:43.529264+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:43.529264+0000","last_undegraded":"2024-09-16T17:00:43.529264+0000","last_fullsized":"2024-09-16T17:00:43.529264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'484","reported_seq":508,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.493614+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:43.493614+0000","last_peered":"2024-09-16T17:00:43.493614+0000","last_clean":"2024-09-16T17:00:43.493614+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:43.493614+0000","last_undegraded":"2024-09-16T17:00:43.493614+0000","last_fullsized":"2024-09-16T17:00:43.493614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":30976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.367576+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:43.367576+0000","last_peered":"2024-09-16T17:00:43.367576+0000","last_clean":"2024-09-16T17:00:43.367576+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:43.367576+0000","last_undegraded":"2024-09-16T17:00:43.367576+0000","last_fullsized":"2024-09-16T17:00:43.367576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.444814+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:43.444814+0000","last_peered":"2024-09-16T17:00:43.444814+0000","last_clean":"2024-09-16T17:00:43.444814+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:43.444814+0000","last_undegraded":"2024-09-16T17:00:43.444814+0000","last_fullsized":"2024-09-16T17:00:43.444814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'514","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.887973+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:43.887973+0000","last_peered":"2024-09-16T17:00:43.887973+0000","last_clean":"2024-09-16T17:00:43.887973+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:43.887973+0000","last_undegraded":"2024-09-16T17:00:43.887973+0000","last_fullsized":"2024-09-16T17:00:43.887973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'455","reported_seq":479,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.721969+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:43.721969+0000","last_peered":"2024-09-16T17:00:43.721969+0000","last_clean":"2024-09-16T17:00:43.721969+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:43.721969+0000","last_undegraded":"2024-09-16T17:00:43.721969+0000","last_fullsized":"2024-09-16T17:00:43.721969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'467","reported_seq":491,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.547270+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:43.547270+0000","last_peered":"2024-09-16T17:00:43.547270+0000","last_clean":"2024-09-16T17:00:43.547270+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:43.547270+0000","last_undegraded":"2024-09-16T17:00:43.547270+0000","last_fullsized":"2024-09-16T17:00:43.547270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":492240896,"num_objects":7511,"num_object_clones":0,"num_object_copies":22533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7511,"num_write_kb":480704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225821184,"internally_reserved":0,"allocated":2985672704,"data_stored":2985672704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7511,"ondisk_log_size":7511,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225952256,"internally_reserved":0,"allocated":2985541632,"data_stored":2985541632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":907440,"kb_used_data":907440,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51390288,"statfs":{"total":53552873472,"available":52623654912,"internally_reserved":0,"allocated":929218560,"data_stored":929218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":550084,"kb_used_data":550084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51747644,"statfs":{"total":53552873472,"available":52989587456,"internally_reserved":0,"allocated":563286016,"data_stored":563286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":786564,"kb_used_data":786564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51511164,"statfs":{"total":53552873472,"available":52747431936,"internally_reserved":0,"allocated":805441536,"data_stored":805441536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":655488,"kb_used_data":655488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51642240,"statfs":{"total":53552873472,"available":52881653760,"internally_reserved":0,"allocated":671219712,"data_stored":671219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52745723904,"internally_reserved":0,"allocated":807149568,"data_stored":807149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52745592832,"internally_reserved":0,"allocated":807280640,"data_stored":807280640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:57.088 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 85 16 8898 8882 6.53021 6.25 0.129733 0.15295 2024-09-16T17:00:58.089 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 86 16 9005 8989 6.53203 6.6875 0.0440653 0.152929 2024-09-16T17:00:58.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:59.089 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 87 16 9106 9090 6.5295 6.3125 0.219468 0.152862 2024-09-16T17:00:59.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:59.091+0000 7fe95bad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:59.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:00:59.100+0000 7fe95bad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:00.089 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 88 16 9210 9194 6.52916 6.5 0.207543 0.153003 2024-09-16T17:01:01.089 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 89 16 9321 9305 6.53374 6.9375 0.208344 0.152883 2024-09-16T17:01:01.519 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:01.568 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:01.568 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:01.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:01.655+0000 7f86c6ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:01.663+0000 7f86c6ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:01.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:01.723+0000 7f6eba751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:01.738+0000 7f6eba751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:02.089 INFO:tasks.radosbench.radosbench.0.smithi103.stdout: 90 15 9421 9406 6.53125 6.3125 0.111541 0.152946 2024-09-16T17:01:02.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:02.103 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:02.128 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2024-09-16T17:01:01.937393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":492831283,"num_objects":7515,"num_object_clones":0,"num_object_copies":22545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7592,"num_write_kb":481812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7566,"ondisk_log_size":7566,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2899576,"kb_used_data":2899576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206291336,"statfs":{"total":214211493888,"available":211242328064,"internally_reserved":0,"allocated":2969165824,"data_stored":2969165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002668"},"pg_stats":[{"pgid":"7.f","version":"92'495","reported_seq":519,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.647923+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:43.647923+0000","last_peered":"2024-09-16T17:00:43.647923+0000","last_clean":"2024-09-16T17:00:43.647923+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:43.647923+0000","last_undegraded":"2024-09-16T17:00:43.647923+0000","last_fullsized":"2024-09-16T17:00:43.647923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.504244+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:43.504244+0000","last_peered":"2024-09-16T17:00:43.504244+0000","last_clean":"2024-09-16T17:00:43.504244+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:43.504244+0000","last_undegraded":"2024-09-16T17:00:43.504244+0000","last_fullsized":"2024-09-16T17:00:43.504244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'483","reported_seq":507,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.609770+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:43.609770+0000","last_peered":"2024-09-16T17:00:43.609770+0000","last_clean":"2024-09-16T17:00:43.609770+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:43.609770+0000","last_undegraded":"2024-09-16T17:00:43.609770+0000","last_fullsized":"2024-09-16T17:00:43.609770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":30912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'457","reported_seq":481,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.575760+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:43.575760+0000","last_peered":"2024-09-16T17:00:43.575760+0000","last_clean":"2024-09-16T17:00:43.575760+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:43.575760+0000","last_undegraded":"2024-09-16T17:00:43.575760+0000","last_fullsized":"2024-09-16T17:00:43.575760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.827262+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:43.827262+0000","last_peered":"2024-09-16T17:00:43.827262+0000","last_clean":"2024-09-16T17:00:43.827262+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:43.827262+0000","last_undegraded":"2024-09-16T17:00:43.827262+0000","last_fullsized":"2024-09-16T17:00:43.827262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'470","reported_seq":494,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.669948+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:43.669948+0000","last_peered":"2024-09-16T17:00:43.669948+0000","last_clean":"2024-09-16T17:00:43.669948+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:43.669948+0000","last_undegraded":"2024-09-16T17:00:43.669948+0000","last_fullsized":"2024-09-16T17:00:43.669948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'486","reported_seq":510,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.715505+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:43.715505+0000","last_peered":"2024-09-16T17:00:43.715505+0000","last_clean":"2024-09-16T17:00:43.715505+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:43.715505+0000","last_undegraded":"2024-09-16T17:00:43.715505+0000","last_fullsized":"2024-09-16T17:00:43.715505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":31104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'439","reported_seq":463,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.480154+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:43.480154+0000","last_peered":"2024-09-16T17:00:43.480154+0000","last_clean":"2024-09-16T17:00:43.480154+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:43.480154+0000","last_undegraded":"2024-09-16T17:00:43.480154+0000","last_fullsized":"2024-09-16T17:00:43.480154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'473","reported_seq":497,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.622567+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:43.622567+0000","last_peered":"2024-09-16T17:00:43.622567+0000","last_clean":"2024-09-16T17:00:43.622567+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:43.622567+0000","last_undegraded":"2024-09-16T17:00:43.622567+0000","last_fullsized":"2024-09-16T17:00:43.622567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'462","reported_seq":486,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.529264+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:43.529264+0000","last_peered":"2024-09-16T17:00:43.529264+0000","last_clean":"2024-09-16T17:00:43.529264+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:43.529264+0000","last_undegraded":"2024-09-16T17:00:43.529264+0000","last_fullsized":"2024-09-16T17:00:43.529264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'484","reported_seq":508,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.493614+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:43.493614+0000","last_peered":"2024-09-16T17:00:43.493614+0000","last_clean":"2024-09-16T17:00:43.493614+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:43.493614+0000","last_undegraded":"2024-09-16T17:00:43.493614+0000","last_fullsized":"2024-09-16T17:00:43.493614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":30976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.367576+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:43.367576+0000","last_peered":"2024-09-16T17:00:43.367576+0000","last_clean":"2024-09-16T17:00:43.367576+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:43.367576+0000","last_undegraded":"2024-09-16T17:00:43.367576+0000","last_fullsized":"2024-09-16T17:00:43.367576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.444814+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:43.444814+0000","last_peered":"2024-09-16T17:00:43.444814+0000","last_clean":"2024-09-16T17:00:43.444814+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:43.444814+0000","last_undegraded":"2024-09-16T17:00:43.444814+0000","last_fullsized":"2024-09-16T17:00:43.444814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'514","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.887973+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:43.887973+0000","last_peered":"2024-09-16T17:00:43.887973+0000","last_clean":"2024-09-16T17:00:43.887973+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:43.887973+0000","last_undegraded":"2024-09-16T17:00:43.887973+0000","last_fullsized":"2024-09-16T17:00:43.887973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'455","reported_seq":479,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.721969+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:43.721969+0000","last_peered":"2024-09-16T17:00:43.721969+0000","last_clean":"2024-09-16T17:00:43.721969+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:43.721969+0000","last_undegraded":"2024-09-16T17:00:43.721969+0000","last_fullsized":"2024-09-16T17:00:43.721969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'467","reported_seq":491,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.547270+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:43.547270+0000","last_peered":"2024-09-16T17:00:43.547270+0000","last_clean":"2024-09-16T17:00:43.547270+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:43.547270+0000","last_undegraded":"2024-09-16T17:00:43.547270+0000","last_fullsized":"2024-09-16T17:00:43.547270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":492240896,"num_objects":7511,"num_object_clones":0,"num_object_copies":22533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7511,"num_write_kb":480704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225821184,"internally_reserved":0,"allocated":2985672704,"data_stored":2985672704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7511,"ondisk_log_size":7511,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225952256,"internally_reserved":0,"allocated":2985541632,"data_stored":2985541632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":907440,"kb_used_data":907440,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51390288,"statfs":{"total":53552873472,"available":52623654912,"internally_reserved":0,"allocated":929218560,"data_stored":929218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":550084,"kb_used_data":550084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51747644,"statfs":{"total":53552873472,"available":52989587456,"internally_reserved":0,"allocated":563286016,"data_stored":563286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":786564,"kb_used_data":786564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51511164,"statfs":{"total":53552873472,"available":52747431936,"internally_reserved":0,"allocated":805441536,"data_stored":805441536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":655488,"kb_used_data":655488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51642240,"statfs":{"total":53552873472,"available":52881653760,"internally_reserved":0,"allocated":671219712,"data_stored":671219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52745723904,"internally_reserved":0,"allocated":807149568,"data_stored":807149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52745592832,"internally_reserved":0,"allocated":807280640,"data_stored":807280640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total time run: 90.1302 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Total writes made: 9421 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Write size: 65536 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Object size: 65536 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Bandwidth (MB/sec): 6.53291 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Bandwidth: 0.569768 2024-09-16T17:01:03.090 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max bandwidth (MB/sec): 7.6875 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min bandwidth (MB/sec): 4.5625 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average IOPS: 104 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev IOPS: 9.11628 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max IOPS: 123 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min IOPS: 73 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Average Latency(s): 0.152964 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Stddev Latency(s): 0.104118 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Max latency(s): 1.19893 2024-09-16T17:01:03.091 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Min latency(s): 0.0216933 2024-09-16T17:01:03.130 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T17:01:04.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:04.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:04.216+0000 7f856a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:04.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:04.224+0000 7f856a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:06.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:06.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:06.925+0000 7f7b75046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:06.931+0000 7f7b75046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:07.130 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:07.130 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:07.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:07.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:07.287+0000 7f277f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:07.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:07.301+0000 7f277f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:07.610 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:07.610 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:07.627 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":514,"stamp":"2024-09-16T17:01:05.938292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":492831283,"num_objects":7515,"num_object_clones":0,"num_object_copies":22545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7592,"num_write_kb":481812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7566,"ondisk_log_size":7566,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2899576,"kb_used_data":2899576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206291336,"statfs":{"total":214211493888,"available":211242328064,"internally_reserved":0,"allocated":2969165824,"data_stored":2969165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002669"},"pg_stats":[{"pgid":"7.f","version":"92'495","reported_seq":519,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.647923+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:00:43.647923+0000","last_peered":"2024-09-16T17:00:43.647923+0000","last_clean":"2024-09-16T17:00:43.647923+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:00:43.647923+0000","last_undegraded":"2024-09-16T17:00:43.647923+0000","last_fullsized":"2024-09-16T17:00:43.647923+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.504244+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:00:43.504244+0000","last_peered":"2024-09-16T17:00:43.504244+0000","last_clean":"2024-09-16T17:00:43.504244+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:00:43.504244+0000","last_undegraded":"2024-09-16T17:00:43.504244+0000","last_fullsized":"2024-09-16T17:00:43.504244+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'483","reported_seq":507,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.609770+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:00:43.609770+0000","last_peered":"2024-09-16T17:00:43.609770+0000","last_clean":"2024-09-16T17:00:43.609770+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:00:43.609770+0000","last_undegraded":"2024-09-16T17:00:43.609770+0000","last_fullsized":"2024-09-16T17:00:43.609770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":483,"num_write_kb":30912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'457","reported_seq":481,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.575760+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:00:43.575760+0000","last_peered":"2024-09-16T17:00:43.575760+0000","last_clean":"2024-09-16T17:00:43.575760+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:00:43.575760+0000","last_undegraded":"2024-09-16T17:00:43.575760+0000","last_fullsized":"2024-09-16T17:00:43.575760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":457,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.827262+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:00:43.827262+0000","last_peered":"2024-09-16T17:00:43.827262+0000","last_clean":"2024-09-16T17:00:43.827262+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:00:43.827262+0000","last_undegraded":"2024-09-16T17:00:43.827262+0000","last_fullsized":"2024-09-16T17:00:43.827262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'470","reported_seq":494,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.669948+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:00:43.669948+0000","last_peered":"2024-09-16T17:00:43.669948+0000","last_clean":"2024-09-16T17:00:43.669948+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:00:43.669948+0000","last_undegraded":"2024-09-16T17:00:43.669948+0000","last_fullsized":"2024-09-16T17:00:43.669948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":470,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'486","reported_seq":510,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.715505+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:00:43.715505+0000","last_peered":"2024-09-16T17:00:43.715505+0000","last_clean":"2024-09-16T17:00:43.715505+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:00:43.715505+0000","last_undegraded":"2024-09-16T17:00:43.715505+0000","last_fullsized":"2024-09-16T17:00:43.715505+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":31104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'439","reported_seq":463,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.480154+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:00:43.480154+0000","last_peered":"2024-09-16T17:00:43.480154+0000","last_clean":"2024-09-16T17:00:43.480154+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:00:43.480154+0000","last_undegraded":"2024-09-16T17:00:43.480154+0000","last_fullsized":"2024-09-16T17:00:43.480154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'473","reported_seq":497,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.622567+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:00:43.622567+0000","last_peered":"2024-09-16T17:00:43.622567+0000","last_clean":"2024-09-16T17:00:43.622567+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:00:43.622567+0000","last_undegraded":"2024-09-16T17:00:43.622567+0000","last_fullsized":"2024-09-16T17:00:43.622567+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'462","reported_seq":486,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.529264+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:00:43.529264+0000","last_peered":"2024-09-16T17:00:43.529264+0000","last_clean":"2024-09-16T17:00:43.529264+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:00:43.529264+0000","last_undegraded":"2024-09-16T17:00:43.529264+0000","last_fullsized":"2024-09-16T17:00:43.529264+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'484","reported_seq":508,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.493614+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:00:43.493614+0000","last_peered":"2024-09-16T17:00:43.493614+0000","last_clean":"2024-09-16T17:00:43.493614+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:00:43.493614+0000","last_undegraded":"2024-09-16T17:00:43.493614+0000","last_fullsized":"2024-09-16T17:00:43.493614+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":484,"num_write_kb":30976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'472","reported_seq":496,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.367576+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:00:43.367576+0000","last_peered":"2024-09-16T17:00:43.367576+0000","last_clean":"2024-09-16T17:00:43.367576+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:00:43.367576+0000","last_undegraded":"2024-09-16T17:00:43.367576+0000","last_fullsized":"2024-09-16T17:00:43.367576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'441","reported_seq":465,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.444814+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:00:43.444814+0000","last_peered":"2024-09-16T17:00:43.444814+0000","last_clean":"2024-09-16T17:00:43.444814+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:00:43.444814+0000","last_undegraded":"2024-09-16T17:00:43.444814+0000","last_fullsized":"2024-09-16T17:00:43.444814+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'514","reported_seq":538,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.887973+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:00:43.887973+0000","last_peered":"2024-09-16T17:00:43.887973+0000","last_clean":"2024-09-16T17:00:43.887973+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:00:43.887973+0000","last_undegraded":"2024-09-16T17:00:43.887973+0000","last_fullsized":"2024-09-16T17:00:43.887973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'455","reported_seq":479,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.721969+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:00:43.721969+0000","last_peered":"2024-09-16T17:00:43.721969+0000","last_clean":"2024-09-16T17:00:43.721969+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:00:43.721969+0000","last_undegraded":"2024-09-16T17:00:43.721969+0000","last_fullsized":"2024-09-16T17:00:43.721969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'467","reported_seq":491,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:43.547270+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:00:43.547270+0000","last_peered":"2024-09-16T17:00:43.547270+0000","last_clean":"2024-09-16T17:00:43.547270+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:00:43.547270+0000","last_undegraded":"2024-09-16T17:00:43.547270+0000","last_fullsized":"2024-09-16T17:00:43.547270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":492240896,"num_objects":7511,"num_object_clones":0,"num_object_copies":22533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7511,"num_write_kb":480704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225821184,"internally_reserved":0,"allocated":2985672704,"data_stored":2985672704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7511,"ondisk_log_size":7511,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211225952256,"internally_reserved":0,"allocated":2985541632,"data_stored":2985541632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":907440,"kb_used_data":907440,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51390288,"statfs":{"total":53552873472,"available":52623654912,"internally_reserved":0,"allocated":929218560,"data_stored":929218560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":550084,"kb_used_data":550084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51747644,"statfs":{"total":53552873472,"available":52989587456,"internally_reserved":0,"allocated":563286016,"data_stored":563286016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":786564,"kb_used_data":786564,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51511164,"statfs":{"total":53552873472,"available":52747431936,"internally_reserved":0,"allocated":805441536,"data_stored":805441536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":655488,"kb_used_data":655488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51642240,"statfs":{"total":53552873472,"available":52881653760,"internally_reserved":0,"allocated":671219712,"data_stored":671219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52745723904,"internally_reserved":0,"allocated":807149568,"data_stored":807149568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52875190272,"internally_reserved":0,"allocated":677683200,"data_stored":677683200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52745592832,"internally_reserved":0,"allocated":807280640,"data_stored":807280640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52983382016,"internally_reserved":0,"allocated":569491456,"data_stored":569491456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52621656064,"internally_reserved":0,"allocated":931217408,"data_stored":931217408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:09.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:09.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:09.550+0000 7f3171efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:09.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:09.558+0000 7f3171efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:11.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:12.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:12.059+0000 7f94f3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:12.067+0000 7f94f3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:12.628 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:12.628 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:01:12.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:01:12.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:12.800+0000 7fbc856d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:12.813+0000 7fbc856d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.845 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:12.846 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:12.847 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:12.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:12.851 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:12.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:01:13.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.017+0000 7f13dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.031+0000 7f13dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:13.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:13.085 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:13.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:01:13.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.254+0000 7fb0582fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.266+0000 7fb0582fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:13.284 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:13.288 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:13.288 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:13.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:01:13.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.409+0000 7ff90f4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:13.421+0000 7ff90f4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:13.450 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:13.451 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:13.453 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:13.454 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:14.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:14.641+0000 7f433ec93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:14.648+0000 7f433ec93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.026 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:17.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:17.188+0000 7f04ce351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:17.195+0000 7f04ce351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:18.454 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:18.455 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:18.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:18.588+0000 7fa580f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:18.598+0000 7fa580f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:18.849 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:18.849 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2024-09-16T17:01:17.940847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":526778955,"num_objects":8034,"num_object_clones":0,"num_object_copies":24102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10895,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10869,"ondisk_log_size":10869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3148080,"kb_used_data":3148080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206042832,"statfs":{"total":214211493888,"available":210987859968,"internally_reserved":0,"allocated":3223633920,"data_stored":3223633920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33947672,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3303,"num_write_kb":122241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002554"},"pg_stats":[{"pgid":"7.f","version":"92'685","reported_seq":709,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.663476+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:13.663476+0000","last_peered":"2024-09-16T17:01:13.663476+0000","last_clean":"2024-09-16T17:01:13.663476+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:13.663476+0000","last_undegraded":"2024-09-16T17:01:13.663476+0000","last_fullsized":"2024-09-16T17:01:13.663476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'652","reported_seq":676,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.720643+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:13.720643+0000","last_peered":"2024-09-16T17:01:13.720643+0000","last_clean":"2024-09-16T17:01:13.720643+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:13.720643+0000","last_undegraded":"2024-09-16T17:01:13.720643+0000","last_fullsized":"2024-09-16T17:01:13.720643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31588352,"num_objects":482,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'678","reported_seq":703,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.732204+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:13.732204+0000","last_peered":"2024-09-16T17:01:13.732204+0000","last_clean":"2024-09-16T17:01:13.732204+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:13.732204+0000","last_undegraded":"2024-09-16T17:01:13.732204+0000","last_fullsized":"2024-09-16T17:01:13.732204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488920,"num_objects":512,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":678,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'671","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.368261+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:13.368261+0000","last_peered":"2024-09-16T17:01:13.368261+0000","last_clean":"2024-09-16T17:01:13.368261+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:13.368261+0000","last_undegraded":"2024-09-16T17:01:13.368261+0000","last_fullsized":"2024-09-16T17:01:13.368261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488896,"num_objects":511,"num_object_clones":0,"num_object_copies":1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'663","reported_seq":687,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488278+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:13.488278+0000","last_peered":"2024-09-16T17:01:13.488278+0000","last_clean":"2024-09-16T17:01:13.488278+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:13.488278+0000","last_undegraded":"2024-09-16T17:01:13.488278+0000","last_fullsized":"2024-09-16T17:01:13.488278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'686","reported_seq":710,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488312+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:13.488312+0000","last_peered":"2024-09-16T17:01:13.488312+0000","last_clean":"2024-09-16T17:01:13.488312+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:13.488312+0000","last_undegraded":"2024-09-16T17:01:13.488312+0000","last_fullsized":"2024-09-16T17:01:13.488312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'674","reported_seq":698,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.128145+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:13.128145+0000","last_peered":"2024-09-16T17:01:13.128145+0000","last_clean":"2024-09-16T17:01:13.128145+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:13.128145+0000","last_undegraded":"2024-09-16T17:01:13.128145+0000","last_fullsized":"2024-09-16T17:01:13.128145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":674,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'666","reported_seq":690,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.742515+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:13.742515+0000","last_peered":"2024-09-16T17:01:13.742515+0000","last_clean":"2024-09-16T17:01:13.742515+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:13.742515+0000","last_undegraded":"2024-09-16T17:01:13.742515+0000","last_fullsized":"2024-09-16T17:01:13.742515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'675","reported_seq":699,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.837493+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:13.837493+0000","last_peered":"2024-09-16T17:01:13.837493+0000","last_clean":"2024-09-16T17:01:13.837493+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:13.837493+0000","last_undegraded":"2024-09-16T17:01:13.837493+0000","last_fullsized":"2024-09-16T17:01:13.837493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32833536,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'657","reported_seq":681,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.035299+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:13.035299+0000","last_peered":"2024-09-16T17:01:13.035299+0000","last_clean":"2024-09-16T17:01:13.035299+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:13.035299+0000","last_undegraded":"2024-09-16T17:01:13.035299+0000","last_fullsized":"2024-09-16T17:01:13.035299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'692","reported_seq":716,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.944052+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:13.944052+0000","last_peered":"2024-09-16T17:01:13.944052+0000","last_clean":"2024-09-16T17:01:13.944052+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:13.944052+0000","last_undegraded":"2024-09-16T17:01:13.944052+0000","last_fullsized":"2024-09-16T17:01:13.944052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'682","reported_seq":706,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.657319+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:13.657319+0000","last_peered":"2024-09-16T17:01:13.657319+0000","last_clean":"2024-09-16T17:01:13.657319+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:13.657319+0000","last_undegraded":"2024-09-16T17:01:13.657319+0000","last_fullsized":"2024-09-16T17:01:13.657319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'656","reported_seq":680,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.569083+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:13.569083+0000","last_peered":"2024-09-16T17:01:13.569083+0000","last_clean":"2024-09-16T17:01:13.569083+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:13.569083+0000","last_undegraded":"2024-09-16T17:01:13.569083+0000","last_fullsized":"2024-09-16T17:01:13.569083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'731","reported_seq":755,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.909358+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:13.909358+0000","last_peered":"2024-09-16T17:01:13.909358+0000","last_clean":"2024-09-16T17:01:13.909358+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:13.909358+0000","last_undegraded":"2024-09-16T17:01:13.909358+0000","last_fullsized":"2024-09-16T17:01:13.909358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'655","reported_seq":679,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.089688+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:13.089688+0000","last_peered":"2024-09-16T17:01:13.089688+0000","last_clean":"2024-09-16T17:01:13.089688+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:13.089688+0000","last_undegraded":"2024-09-16T17:01:13.089688+0000","last_fullsized":"2024-09-16T17:01:13.089688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'691","reported_seq":715,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.667275+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:13.667275+0000","last_peered":"2024-09-16T17:01:13.667275+0000","last_clean":"2024-09-16T17:01:13.667275+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:13.667275+0000","last_undegraded":"2024-09-16T17:01:13.667275+0000","last_fullsized":"2024-09-16T17:01:13.667275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":526188568,"num_objects":8030,"num_object_clones":0,"num_object_copies":24090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10814,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10814,"ondisk_log_size":10814,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":982340,"kb_used_data":982340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51315388,"statfs":{"total":53552873472,"available":52546957312,"internally_reserved":0,"allocated":1005916160,"data_stored":1005916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":591576,"kb_used_data":591576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51706152,"statfs":{"total":53552873472,"available":52947099648,"internally_reserved":0,"allocated":605773824,"data_stored":605773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":855548,"kb_used_data":855548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51442180,"statfs":{"total":53552873472,"available":52676792320,"internally_reserved":0,"allocated":876081152,"data_stored":876081152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":718616,"kb_used_data":718616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579112,"statfs":{"total":53552873472,"available":52817010688,"internally_reserved":0,"allocated":735862784,"data_stored":735862784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:19.686 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:19.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:19.846+0000 7f39e7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:19.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:19.853+0000 7f39e7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:22.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:22.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:22.385+0000 7f249e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:22.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:22.394+0000 7f249e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:23.871 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:23.872 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:23.872 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:01:23.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:01:24.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.000+0000 7f93a4a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.013+0000 7f93a4a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:24.111 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:24.115 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:24.115 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:24.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:01:24.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.269+0000 7f34f8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.281+0000 7f34f8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.323 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:24.323 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:24.323 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:24.324 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:24.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:24.327 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:24.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:01:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.486+0000 7f2a4b0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.498+0000 7f2a4b0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:24.641 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:24.642 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:24.642 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:24.644 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:24.644 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:24.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:01:24.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:24.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.810+0000 7fab09911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.827+0000 7fab09911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.843+0000 7fcf6489c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:24.851+0000 7fcf6489c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.995 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:24.996 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:24.999 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:24.999 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:27.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:27.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:27.441+0000 7fb66d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:27.447+0000 7fb66d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:29.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:29.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:29.824+0000 7f75130a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:29.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:29.834+0000 7f75130a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:30.000 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:30.001 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:30.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:30.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:30.140+0000 7f9686f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:30.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:30.150+0000 7f9686f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:30.427 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:30.427 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:30.450 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2024-09-16T17:01:29.943450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":526778955,"num_objects":8034,"num_object_clones":0,"num_object_copies":24102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10895,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10869,"ondisk_log_size":10869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3148080,"kb_used_data":3148080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206042832,"statfs":{"total":214211493888,"available":210987859968,"internally_reserved":0,"allocated":3223633920,"data_stored":3223633920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002602"},"pg_stats":[{"pgid":"7.f","version":"92'685","reported_seq":709,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.663476+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:13.663476+0000","last_peered":"2024-09-16T17:01:13.663476+0000","last_clean":"2024-09-16T17:01:13.663476+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:13.663476+0000","last_undegraded":"2024-09-16T17:01:13.663476+0000","last_fullsized":"2024-09-16T17:01:13.663476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'652","reported_seq":676,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.720643+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:13.720643+0000","last_peered":"2024-09-16T17:01:13.720643+0000","last_clean":"2024-09-16T17:01:13.720643+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:13.720643+0000","last_undegraded":"2024-09-16T17:01:13.720643+0000","last_fullsized":"2024-09-16T17:01:13.720643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31588352,"num_objects":482,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'678","reported_seq":703,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.732204+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:13.732204+0000","last_peered":"2024-09-16T17:01:13.732204+0000","last_clean":"2024-09-16T17:01:13.732204+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:13.732204+0000","last_undegraded":"2024-09-16T17:01:13.732204+0000","last_fullsized":"2024-09-16T17:01:13.732204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488920,"num_objects":512,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":678,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'671","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.368261+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:13.368261+0000","last_peered":"2024-09-16T17:01:13.368261+0000","last_clean":"2024-09-16T17:01:13.368261+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:13.368261+0000","last_undegraded":"2024-09-16T17:01:13.368261+0000","last_fullsized":"2024-09-16T17:01:13.368261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488896,"num_objects":511,"num_object_clones":0,"num_object_copies":1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'663","reported_seq":687,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488278+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:13.488278+0000","last_peered":"2024-09-16T17:01:13.488278+0000","last_clean":"2024-09-16T17:01:13.488278+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:13.488278+0000","last_undegraded":"2024-09-16T17:01:13.488278+0000","last_fullsized":"2024-09-16T17:01:13.488278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'686","reported_seq":710,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488312+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:13.488312+0000","last_peered":"2024-09-16T17:01:13.488312+0000","last_clean":"2024-09-16T17:01:13.488312+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:13.488312+0000","last_undegraded":"2024-09-16T17:01:13.488312+0000","last_fullsized":"2024-09-16T17:01:13.488312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'674","reported_seq":698,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.128145+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:13.128145+0000","last_peered":"2024-09-16T17:01:13.128145+0000","last_clean":"2024-09-16T17:01:13.128145+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:13.128145+0000","last_undegraded":"2024-09-16T17:01:13.128145+0000","last_fullsized":"2024-09-16T17:01:13.128145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":674,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'666","reported_seq":690,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.742515+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:13.742515+0000","last_peered":"2024-09-16T17:01:13.742515+0000","last_clean":"2024-09-16T17:01:13.742515+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:13.742515+0000","last_undegraded":"2024-09-16T17:01:13.742515+0000","last_fullsized":"2024-09-16T17:01:13.742515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'675","reported_seq":699,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.837493+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:13.837493+0000","last_peered":"2024-09-16T17:01:13.837493+0000","last_clean":"2024-09-16T17:01:13.837493+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:13.837493+0000","last_undegraded":"2024-09-16T17:01:13.837493+0000","last_fullsized":"2024-09-16T17:01:13.837493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32833536,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'657","reported_seq":681,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.035299+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:13.035299+0000","last_peered":"2024-09-16T17:01:13.035299+0000","last_clean":"2024-09-16T17:01:13.035299+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:13.035299+0000","last_undegraded":"2024-09-16T17:01:13.035299+0000","last_fullsized":"2024-09-16T17:01:13.035299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'692","reported_seq":716,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.944052+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:13.944052+0000","last_peered":"2024-09-16T17:01:13.944052+0000","last_clean":"2024-09-16T17:01:13.944052+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:13.944052+0000","last_undegraded":"2024-09-16T17:01:13.944052+0000","last_fullsized":"2024-09-16T17:01:13.944052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'682","reported_seq":706,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.657319+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:13.657319+0000","last_peered":"2024-09-16T17:01:13.657319+0000","last_clean":"2024-09-16T17:01:13.657319+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:13.657319+0000","last_undegraded":"2024-09-16T17:01:13.657319+0000","last_fullsized":"2024-09-16T17:01:13.657319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'656","reported_seq":680,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.569083+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:13.569083+0000","last_peered":"2024-09-16T17:01:13.569083+0000","last_clean":"2024-09-16T17:01:13.569083+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:13.569083+0000","last_undegraded":"2024-09-16T17:01:13.569083+0000","last_fullsized":"2024-09-16T17:01:13.569083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'731","reported_seq":755,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.909358+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:13.909358+0000","last_peered":"2024-09-16T17:01:13.909358+0000","last_clean":"2024-09-16T17:01:13.909358+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:13.909358+0000","last_undegraded":"2024-09-16T17:01:13.909358+0000","last_fullsized":"2024-09-16T17:01:13.909358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'655","reported_seq":679,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.089688+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:13.089688+0000","last_peered":"2024-09-16T17:01:13.089688+0000","last_clean":"2024-09-16T17:01:13.089688+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:13.089688+0000","last_undegraded":"2024-09-16T17:01:13.089688+0000","last_fullsized":"2024-09-16T17:01:13.089688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'691","reported_seq":715,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.667275+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:13.667275+0000","last_peered":"2024-09-16T17:01:13.667275+0000","last_clean":"2024-09-16T17:01:13.667275+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:13.667275+0000","last_undegraded":"2024-09-16T17:01:13.667275+0000","last_fullsized":"2024-09-16T17:01:13.667275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":526188568,"num_objects":8030,"num_object_clones":0,"num_object_copies":24090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10814,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10814,"ondisk_log_size":10814,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":982340,"kb_used_data":982340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51315388,"statfs":{"total":53552873472,"available":52546957312,"internally_reserved":0,"allocated":1005916160,"data_stored":1005916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":591576,"kb_used_data":591576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51706152,"statfs":{"total":53552873472,"available":52947099648,"internally_reserved":0,"allocated":605773824,"data_stored":605773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":855548,"kb_used_data":855548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51442180,"statfs":{"total":53552873472,"available":52676792320,"internally_reserved":0,"allocated":876081152,"data_stored":876081152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":718616,"kb_used_data":718616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579112,"statfs":{"total":53552873472,"available":52817010688,"internally_reserved":0,"allocated":735862784,"data_stored":735862784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:32.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:32.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:32.340+0000 7ff7ce67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:32.347+0000 7ff7ce67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:34.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:35.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:35.012+0000 7f193ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:35.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:35.019+0000 7f193ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:35.453 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:35.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:35.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:35.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:35.572+0000 7f2ec4263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:35.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:35.582+0000 7f2ec4263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:35.890 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:35.890 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:35.910 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-09-16T17:01:33.944293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":526778955,"num_objects":8034,"num_object_clones":0,"num_object_copies":24102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10895,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10869,"ondisk_log_size":10869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3148080,"kb_used_data":3148080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206042832,"statfs":{"total":214211493888,"available":210987859968,"internally_reserved":0,"allocated":3223633920,"data_stored":3223633920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002501"},"pg_stats":[{"pgid":"7.f","version":"92'685","reported_seq":709,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.663476+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:13.663476+0000","last_peered":"2024-09-16T17:01:13.663476+0000","last_clean":"2024-09-16T17:01:13.663476+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:13.663476+0000","last_undegraded":"2024-09-16T17:01:13.663476+0000","last_fullsized":"2024-09-16T17:01:13.663476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'652","reported_seq":676,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.720643+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:13.720643+0000","last_peered":"2024-09-16T17:01:13.720643+0000","last_clean":"2024-09-16T17:01:13.720643+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:13.720643+0000","last_undegraded":"2024-09-16T17:01:13.720643+0000","last_fullsized":"2024-09-16T17:01:13.720643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31588352,"num_objects":482,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'678","reported_seq":703,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.732204+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:13.732204+0000","last_peered":"2024-09-16T17:01:13.732204+0000","last_clean":"2024-09-16T17:01:13.732204+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:13.732204+0000","last_undegraded":"2024-09-16T17:01:13.732204+0000","last_fullsized":"2024-09-16T17:01:13.732204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488920,"num_objects":512,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":678,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'671","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.368261+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:13.368261+0000","last_peered":"2024-09-16T17:01:13.368261+0000","last_clean":"2024-09-16T17:01:13.368261+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:13.368261+0000","last_undegraded":"2024-09-16T17:01:13.368261+0000","last_fullsized":"2024-09-16T17:01:13.368261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488896,"num_objects":511,"num_object_clones":0,"num_object_copies":1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'663","reported_seq":687,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488278+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:13.488278+0000","last_peered":"2024-09-16T17:01:13.488278+0000","last_clean":"2024-09-16T17:01:13.488278+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:13.488278+0000","last_undegraded":"2024-09-16T17:01:13.488278+0000","last_fullsized":"2024-09-16T17:01:13.488278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'686","reported_seq":710,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488312+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:13.488312+0000","last_peered":"2024-09-16T17:01:13.488312+0000","last_clean":"2024-09-16T17:01:13.488312+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:13.488312+0000","last_undegraded":"2024-09-16T17:01:13.488312+0000","last_fullsized":"2024-09-16T17:01:13.488312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'674","reported_seq":698,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.128145+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:13.128145+0000","last_peered":"2024-09-16T17:01:13.128145+0000","last_clean":"2024-09-16T17:01:13.128145+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:13.128145+0000","last_undegraded":"2024-09-16T17:01:13.128145+0000","last_fullsized":"2024-09-16T17:01:13.128145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":674,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'666","reported_seq":690,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.742515+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:13.742515+0000","last_peered":"2024-09-16T17:01:13.742515+0000","last_clean":"2024-09-16T17:01:13.742515+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:13.742515+0000","last_undegraded":"2024-09-16T17:01:13.742515+0000","last_fullsized":"2024-09-16T17:01:13.742515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'675","reported_seq":699,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.837493+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:13.837493+0000","last_peered":"2024-09-16T17:01:13.837493+0000","last_clean":"2024-09-16T17:01:13.837493+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:13.837493+0000","last_undegraded":"2024-09-16T17:01:13.837493+0000","last_fullsized":"2024-09-16T17:01:13.837493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32833536,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'657","reported_seq":681,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.035299+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:13.035299+0000","last_peered":"2024-09-16T17:01:13.035299+0000","last_clean":"2024-09-16T17:01:13.035299+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:13.035299+0000","last_undegraded":"2024-09-16T17:01:13.035299+0000","last_fullsized":"2024-09-16T17:01:13.035299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'692","reported_seq":716,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.944052+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:13.944052+0000","last_peered":"2024-09-16T17:01:13.944052+0000","last_clean":"2024-09-16T17:01:13.944052+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:13.944052+0000","last_undegraded":"2024-09-16T17:01:13.944052+0000","last_fullsized":"2024-09-16T17:01:13.944052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'682","reported_seq":706,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.657319+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:13.657319+0000","last_peered":"2024-09-16T17:01:13.657319+0000","last_clean":"2024-09-16T17:01:13.657319+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:13.657319+0000","last_undegraded":"2024-09-16T17:01:13.657319+0000","last_fullsized":"2024-09-16T17:01:13.657319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'656","reported_seq":680,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.569083+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:13.569083+0000","last_peered":"2024-09-16T17:01:13.569083+0000","last_clean":"2024-09-16T17:01:13.569083+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:13.569083+0000","last_undegraded":"2024-09-16T17:01:13.569083+0000","last_fullsized":"2024-09-16T17:01:13.569083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'731","reported_seq":755,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.909358+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:13.909358+0000","last_peered":"2024-09-16T17:01:13.909358+0000","last_clean":"2024-09-16T17:01:13.909358+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:13.909358+0000","last_undegraded":"2024-09-16T17:01:13.909358+0000","last_fullsized":"2024-09-16T17:01:13.909358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'655","reported_seq":679,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.089688+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:13.089688+0000","last_peered":"2024-09-16T17:01:13.089688+0000","last_clean":"2024-09-16T17:01:13.089688+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:13.089688+0000","last_undegraded":"2024-09-16T17:01:13.089688+0000","last_fullsized":"2024-09-16T17:01:13.089688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'691","reported_seq":715,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.667275+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:13.667275+0000","last_peered":"2024-09-16T17:01:13.667275+0000","last_clean":"2024-09-16T17:01:13.667275+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:13.667275+0000","last_undegraded":"2024-09-16T17:01:13.667275+0000","last_fullsized":"2024-09-16T17:01:13.667275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":526188568,"num_objects":8030,"num_object_clones":0,"num_object_copies":24090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10814,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10814,"ondisk_log_size":10814,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":982340,"kb_used_data":982340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51315388,"statfs":{"total":53552873472,"available":52546957312,"internally_reserved":0,"allocated":1005916160,"data_stored":1005916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":591576,"kb_used_data":591576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51706152,"statfs":{"total":53552873472,"available":52947099648,"internally_reserved":0,"allocated":605773824,"data_stored":605773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":855548,"kb_used_data":855548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51442180,"statfs":{"total":53552873472,"available":52676792320,"internally_reserved":0,"allocated":876081152,"data_stored":876081152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":718616,"kb_used_data":718616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579112,"statfs":{"total":53552873472,"available":52817010688,"internally_reserved":0,"allocated":735862784,"data_stored":735862784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:37.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:37.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:37.396+0000 7f46c2ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:37.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:37.411+0000 7f46c2ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:39.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:39.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:39.948+0000 7fd9590d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:39.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:39.954+0000 7fd9590d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:40.912 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:40.913 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:40.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:41.026+0000 7f4508751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:41.036+0000 7f4508751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:41.257 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:41.257 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:41.273 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":531,"stamp":"2024-09-16T17:01:39.945443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":526778955,"num_objects":8034,"num_object_clones":0,"num_object_copies":24102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10895,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10869,"ondisk_log_size":10869,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3148080,"kb_used_data":3148080,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":206042832,"statfs":{"total":214211493888,"available":210987859968,"internally_reserved":0,"allocated":3223633920,"data_stored":3223633920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002437"},"pg_stats":[{"pgid":"7.f","version":"92'685","reported_seq":709,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.663476+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:13.663476+0000","last_peered":"2024-09-16T17:01:13.663476+0000","last_clean":"2024-09-16T17:01:13.663476+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:13.663476+0000","last_undegraded":"2024-09-16T17:01:13.663476+0000","last_fullsized":"2024-09-16T17:01:13.663476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'652","reported_seq":676,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.720643+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:13.720643+0000","last_peered":"2024-09-16T17:01:13.720643+0000","last_clean":"2024-09-16T17:01:13.720643+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:13.720643+0000","last_undegraded":"2024-09-16T17:01:13.720643+0000","last_fullsized":"2024-09-16T17:01:13.720643+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31588352,"num_objects":482,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'678","reported_seq":703,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.732204+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:13.732204+0000","last_peered":"2024-09-16T17:01:13.732204+0000","last_clean":"2024-09-16T17:01:13.732204+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:13.732204+0000","last_undegraded":"2024-09-16T17:01:13.732204+0000","last_fullsized":"2024-09-16T17:01:13.732204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488920,"num_objects":512,"num_object_clones":0,"num_object_copies":1536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":678,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'671","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.368261+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:13.368261+0000","last_peered":"2024-09-16T17:01:13.368261+0000","last_clean":"2024-09-16T17:01:13.368261+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:13.368261+0000","last_undegraded":"2024-09-16T17:01:13.368261+0000","last_fullsized":"2024-09-16T17:01:13.368261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33488896,"num_objects":511,"num_object_clones":0,"num_object_copies":1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'663","reported_seq":687,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488278+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:13.488278+0000","last_peered":"2024-09-16T17:01:13.488278+0000","last_clean":"2024-09-16T17:01:13.488278+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:13.488278+0000","last_undegraded":"2024-09-16T17:01:13.488278+0000","last_fullsized":"2024-09-16T17:01:13.488278+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":663,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'686","reported_seq":710,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.488312+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:13.488312+0000","last_peered":"2024-09-16T17:01:13.488312+0000","last_clean":"2024-09-16T17:01:13.488312+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:13.488312+0000","last_undegraded":"2024-09-16T17:01:13.488312+0000","last_fullsized":"2024-09-16T17:01:13.488312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'674","reported_seq":698,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.128145+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:13.128145+0000","last_peered":"2024-09-16T17:01:13.128145+0000","last_clean":"2024-09-16T17:01:13.128145+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:13.128145+0000","last_undegraded":"2024-09-16T17:01:13.128145+0000","last_fullsized":"2024-09-16T17:01:13.128145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":674,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'666","reported_seq":690,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.742515+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:13.742515+0000","last_peered":"2024-09-16T17:01:13.742515+0000","last_clean":"2024-09-16T17:01:13.742515+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:13.742515+0000","last_undegraded":"2024-09-16T17:01:13.742515+0000","last_fullsized":"2024-09-16T17:01:13.742515+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'675","reported_seq":699,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.837493+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:13.837493+0000","last_peered":"2024-09-16T17:01:13.837493+0000","last_clean":"2024-09-16T17:01:13.837493+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:13.837493+0000","last_undegraded":"2024-09-16T17:01:13.837493+0000","last_fullsized":"2024-09-16T17:01:13.837493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32833536,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'657","reported_seq":681,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.035299+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:13.035299+0000","last_peered":"2024-09-16T17:01:13.035299+0000","last_clean":"2024-09-16T17:01:13.035299+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:13.035299+0000","last_undegraded":"2024-09-16T17:01:13.035299+0000","last_fullsized":"2024-09-16T17:01:13.035299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'692","reported_seq":716,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.944052+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:13.944052+0000","last_peered":"2024-09-16T17:01:13.944052+0000","last_clean":"2024-09-16T17:01:13.944052+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:13.944052+0000","last_undegraded":"2024-09-16T17:01:13.944052+0000","last_fullsized":"2024-09-16T17:01:13.944052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'682","reported_seq":706,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.657319+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:13.657319+0000","last_peered":"2024-09-16T17:01:13.657319+0000","last_clean":"2024-09-16T17:01:13.657319+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:13.657319+0000","last_undegraded":"2024-09-16T17:01:13.657319+0000","last_fullsized":"2024-09-16T17:01:13.657319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'656","reported_seq":680,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.569083+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:13.569083+0000","last_peered":"2024-09-16T17:01:13.569083+0000","last_clean":"2024-09-16T17:01:13.569083+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:13.569083+0000","last_undegraded":"2024-09-16T17:01:13.569083+0000","last_fullsized":"2024-09-16T17:01:13.569083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'731","reported_seq":755,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.909358+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:13.909358+0000","last_peered":"2024-09-16T17:01:13.909358+0000","last_clean":"2024-09-16T17:01:13.909358+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:13.909358+0000","last_undegraded":"2024-09-16T17:01:13.909358+0000","last_fullsized":"2024-09-16T17:01:13.909358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'655","reported_seq":679,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.089688+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:13.089688+0000","last_peered":"2024-09-16T17:01:13.089688+0000","last_clean":"2024-09-16T17:01:13.089688+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:13.089688+0000","last_undegraded":"2024-09-16T17:01:13.089688+0000","last_fullsized":"2024-09-16T17:01:13.089688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'691","reported_seq":715,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:13.667275+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:13.667275+0000","last_peered":"2024-09-16T17:01:13.667275+0000","last_clean":"2024-09-16T17:01:13.667275+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:13.667275+0000","last_undegraded":"2024-09-16T17:01:13.667275+0000","last_fullsized":"2024-09-16T17:01:13.667275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":526188568,"num_objects":8030,"num_object_clones":0,"num_object_copies":24090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10814,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10814,"ondisk_log_size":10814,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":211004907520,"internally_reserved":0,"allocated":3206586368,"data_stored":3206586368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":982340,"kb_used_data":982340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51315388,"statfs":{"total":53552873472,"available":52546957312,"internally_reserved":0,"allocated":1005916160,"data_stored":1005916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":591576,"kb_used_data":591576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51706152,"statfs":{"total":53552873472,"available":52947099648,"internally_reserved":0,"allocated":605773824,"data_stored":605773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":855548,"kb_used_data":855548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51442180,"statfs":{"total":53552873472,"available":52676792320,"internally_reserved":0,"allocated":876081152,"data_stored":876081152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":718616,"kb_used_data":718616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51579112,"statfs":{"total":53552873472,"available":52817010688,"internally_reserved":0,"allocated":735862784,"data_stored":735862784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":52823699456,"internally_reserved":0,"allocated":729174016,"data_stored":729174016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":52678496256,"internally_reserved":0,"allocated":874377216,"data_stored":874377216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":52953133056,"internally_reserved":0,"allocated":599740416,"data_stored":599740416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52549578752,"internally_reserved":0,"allocated":1003294720,"data_stored":1003294720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:42.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:42.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:42.591+0000 7f1bd8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:42.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:42.603+0000 7f1bd8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:45.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:45.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:45.191+0000 7ff608d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:45.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:45.202+0000 7ff608d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.275 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:46.276 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:46.276 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:01:46.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:01:46.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.440+0000 7f1ce9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.458+0000 7f1ce9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.567 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:46.568 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:46.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:46.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:46.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:01:46.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.705+0000 7f8cbdf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.721+0000 7f8cbdf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.754 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:46.754 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:46.754 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:46.754 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:46.755 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:46.759 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:46.759 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:46.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:01:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.923+0000 7f4ae06fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:46.937+0000 7f4ae06fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:47.001 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:47.002 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:47.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:47.006 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:47.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:01:47.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:47.132+0000 7fa1a3cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:47.144+0000 7fa1a3cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:01:47.184 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:01:47.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:47.189 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:47.570 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:47.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:47.745+0000 7f90ef991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:47.751+0000 7f90ef991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:50.250+0000 7f4049391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:50.259+0000 7f4049391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:52.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:01:52.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:52.307+0000 7f501cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:52.322+0000 7f501cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:52.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:52.656+0000 7f426b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:52.666+0000 7f426b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.809 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:01:52.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:01:53.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:53.016+0000 7f393647d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:53.036+0000 7f393647d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.809 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:01:53.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:01:53.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:53.980+0000 7fed80d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:53.993+0000 7fed80d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.813 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:01:54.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:01:54.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:54.959+0000 7f221e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:54.974+0000 7f221e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.167 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:55.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:55.338+0000 7f826df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:55.345+0000 7f826df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.817 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:01:55.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:01:55.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:55.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:55.956+0000 7f2a3e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:55.965+0000 7f2a3e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:56.198 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-16T17:01:55.949002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":298058315,"num_objects":4544,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14385,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14359,"ondisk_log_size":14359,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1801216,"kb_used_data":1801216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207389696,"statfs":{"total":214211493888,"available":212367048704,"internally_reserved":0,"allocated":1844445184,"data_stored":1844445184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000808"},"pg_stats":[{"pgid":"7.f","version":"92'923","reported_seq":947,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.340166+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:43.340166+0000","last_peered":"2024-09-16T17:01:43.340166+0000","last_clean":"2024-09-16T17:01:43.340166+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:43.340166+0000","last_undegraded":"2024-09-16T17:01:43.340166+0000","last_fullsized":"2024-09-16T17:01:43.340166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'858","reported_seq":882,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.673206+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:43.673206+0000","last_peered":"2024-09-16T17:01:43.673206+0000","last_clean":"2024-09-16T17:01:43.673206+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:43.673206+0000","last_undegraded":"2024-09-16T17:01:43.673206+0000","last_fullsized":"2024-09-16T17:01:43.673206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'912","reported_seq":937,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.820477+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:43.820477+0000","last_peered":"2024-09-16T17:01:43.820477+0000","last_clean":"2024-09-16T17:01:43.820477+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:43.820477+0000","last_undegraded":"2024-09-16T17:01:43.820477+0000","last_fullsized":"2024-09-16T17:01:43.820477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153496,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":912,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'896","reported_seq":920,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.707745+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:43.707745+0000","last_peered":"2024-09-16T17:01:43.707745+0000","last_clean":"2024-09-16T17:01:43.707745+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:43.707745+0000","last_undegraded":"2024-09-16T17:01:43.707745+0000","last_fullsized":"2024-09-16T17:01:43.707745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'848","reported_seq":872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.595403+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:43.595403+0000","last_peered":"2024-09-16T17:01:43.595403+0000","last_clean":"2024-09-16T17:01:43.595403+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:43.595403+0000","last_undegraded":"2024-09-16T17:01:43.595403+0000","last_fullsized":"2024-09-16T17:01:43.595403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'884","reported_seq":908,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.718533+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:43.718533+0000","last_peered":"2024-09-16T17:01:43.718533+0000","last_clean":"2024-09-16T17:01:43.718533+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:43.718533+0000","last_undegraded":"2024-09-16T17:01:43.718533+0000","last_fullsized":"2024-09-16T17:01:43.718533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'907","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.813597+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:43.813597+0000","last_peered":"2024-09-16T17:01:43.813597+0000","last_clean":"2024-09-16T17:01:43.813597+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:43.813597+0000","last_undegraded":"2024-09-16T17:01:43.813597+0000","last_fullsized":"2024-09-16T17:01:43.813597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":907,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'874","reported_seq":898,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.293132+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:43.293132+0000","last_peered":"2024-09-16T17:01:43.293132+0000","last_clean":"2024-09-16T17:01:43.293132+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:43.293132+0000","last_undegraded":"2024-09-16T17:01:43.293132+0000","last_fullsized":"2024-09-16T17:01:43.293132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'915","reported_seq":939,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.675270+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:43.675270+0000","last_peered":"2024-09-16T17:01:43.675270+0000","last_clean":"2024-09-16T17:01:43.675270+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:43.675270+0000","last_undegraded":"2024-09-16T17:01:43.675270+0000","last_fullsized":"2024-09-16T17:01:43.675270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'876","reported_seq":900,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.660361+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:43.660361+0000","last_peered":"2024-09-16T17:01:43.660361+0000","last_clean":"2024-09-16T17:01:43.660361+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:43.660361+0000","last_undegraded":"2024-09-16T17:01:43.660361+0000","last_fullsized":"2024-09-16T17:01:43.660361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'899","reported_seq":923,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.606743+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:43.606743+0000","last_peered":"2024-09-16T17:01:43.606743+0000","last_clean":"2024-09-16T17:01:43.606743+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:43.606743+0000","last_undegraded":"2024-09-16T17:01:43.606743+0000","last_fullsized":"2024-09-16T17:01:43.606743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'892","reported_seq":916,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.373510+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:43.373510+0000","last_peered":"2024-09-16T17:01:43.373510+0000","last_clean":"2024-09-16T17:01:43.373510+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:43.373510+0000","last_undegraded":"2024-09-16T17:01:43.373510+0000","last_fullsized":"2024-09-16T17:01:43.373510+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'849","reported_seq":873,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.315246+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:43.315246+0000","last_peered":"2024-09-16T17:01:43.315246+0000","last_clean":"2024-09-16T17:01:43.315246+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:43.315246+0000","last_undegraded":"2024-09-16T17:01:43.315246+0000","last_fullsized":"2024-09-16T17:01:43.315246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'982","reported_seq":1006,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.672579+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:43.672579+0000","last_peered":"2024-09-16T17:01:43.672579+0000","last_clean":"2024-09-16T17:01:43.672579+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:43.672579+0000","last_undegraded":"2024-09-16T17:01:43.672579+0000","last_fullsized":"2024-09-16T17:01:43.672579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'877","reported_seq":901,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.247019+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:43.247019+0000","last_peered":"2024-09-16T17:01:43.247019+0000","last_clean":"2024-09-16T17:01:43.247019+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:43.247019+0000","last_undegraded":"2024-09-16T17:01:43.247019+0000","last_fullsized":"2024-09-16T17:01:43.247019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'912","reported_seq":936,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.517402+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:43.517402+0000","last_peered":"2024-09-16T17:01:43.517402+0000","last_clean":"2024-09-16T17:01:43.517402+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:43.517402+0000","last_undegraded":"2024-09-16T17:01:43.517402+0000","last_fullsized":"2024-09-16T17:01:43.517402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":297467928,"num_objects":4540,"num_object_clones":0,"num_object_copies":13620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14304,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14304,"ondisk_log_size":14304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":561464,"kb_used_data":561464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51736264,"statfs":{"total":53552873472,"available":52977934336,"internally_reserved":0,"allocated":574939136,"data_stored":574939136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":335920,"kb_used_data":335920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961808,"statfs":{"total":53552873472,"available":53208891392,"internally_reserved":0,"allocated":343982080,"data_stored":343982080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":487416,"kb_used_data":487416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51810312,"statfs":{"total":53552873472,"available":53053759488,"internally_reserved":0,"allocated":499113984,"data_stored":499113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416416,"kb_used_data":416416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51881312,"statfs":{"total":53552873472,"available":53126463488,"internally_reserved":0,"allocated":426409984,"data_stored":426409984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:56.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:56.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:56.353+0000 7f3914f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:56.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:56.364+0000 7f3914f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:56.628 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-16T17:01:55.949002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":298058315,"num_objects":4544,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14385,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14359,"ondisk_log_size":14359,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1801216,"kb_used_data":1801216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207389696,"statfs":{"total":214211493888,"available":212367048704,"internally_reserved":0,"allocated":1844445184,"data_stored":1844445184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000808"},"pg_stats":[{"pgid":"7.f","version":"92'923","reported_seq":947,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.340166+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:43.340166+0000","last_peered":"2024-09-16T17:01:43.340166+0000","last_clean":"2024-09-16T17:01:43.340166+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:43.340166+0000","last_undegraded":"2024-09-16T17:01:43.340166+0000","last_fullsized":"2024-09-16T17:01:43.340166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'858","reported_seq":882,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.673206+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:43.673206+0000","last_peered":"2024-09-16T17:01:43.673206+0000","last_clean":"2024-09-16T17:01:43.673206+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:43.673206+0000","last_undegraded":"2024-09-16T17:01:43.673206+0000","last_fullsized":"2024-09-16T17:01:43.673206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'912","reported_seq":937,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.820477+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:43.820477+0000","last_peered":"2024-09-16T17:01:43.820477+0000","last_clean":"2024-09-16T17:01:43.820477+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:43.820477+0000","last_undegraded":"2024-09-16T17:01:43.820477+0000","last_fullsized":"2024-09-16T17:01:43.820477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153496,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":912,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'896","reported_seq":920,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.707745+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:43.707745+0000","last_peered":"2024-09-16T17:01:43.707745+0000","last_clean":"2024-09-16T17:01:43.707745+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:43.707745+0000","last_undegraded":"2024-09-16T17:01:43.707745+0000","last_fullsized":"2024-09-16T17:01:43.707745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'848","reported_seq":872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.595403+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:43.595403+0000","last_peered":"2024-09-16T17:01:43.595403+0000","last_clean":"2024-09-16T17:01:43.595403+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:43.595403+0000","last_undegraded":"2024-09-16T17:01:43.595403+0000","last_fullsized":"2024-09-16T17:01:43.595403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'884","reported_seq":908,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.718533+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:43.718533+0000","last_peered":"2024-09-16T17:01:43.718533+0000","last_clean":"2024-09-16T17:01:43.718533+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:43.718533+0000","last_undegraded":"2024-09-16T17:01:43.718533+0000","last_fullsized":"2024-09-16T17:01:43.718533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'907","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.813597+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:43.813597+0000","last_peered":"2024-09-16T17:01:43.813597+0000","last_clean":"2024-09-16T17:01:43.813597+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:43.813597+0000","last_undegraded":"2024-09-16T17:01:43.813597+0000","last_fullsized":"2024-09-16T17:01:43.813597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":907,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'874","reported_seq":898,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.293132+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:43.293132+0000","last_peered":"2024-09-16T17:01:43.293132+0000","last_clean":"2024-09-16T17:01:43.293132+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:43.293132+0000","last_undegraded":"2024-09-16T17:01:43.293132+0000","last_fullsized":"2024-09-16T17:01:43.293132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'915","reported_seq":939,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.675270+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:43.675270+0000","last_peered":"2024-09-16T17:01:43.675270+0000","last_clean":"2024-09-16T17:01:43.675270+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:43.675270+0000","last_undegraded":"2024-09-16T17:01:43.675270+0000","last_fullsized":"2024-09-16T17:01:43.675270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'876","reported_seq":900,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.660361+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:43.660361+0000","last_peered":"2024-09-16T17:01:43.660361+0000","last_clean":"2024-09-16T17:01:43.660361+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:43.660361+0000","last_undegraded":"2024-09-16T17:01:43.660361+0000","last_fullsized":"2024-09-16T17:01:43.660361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'899","reported_seq":923,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.606743+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:43.606743+0000","last_peered":"2024-09-16T17:01:43.606743+0000","last_clean":"2024-09-16T17:01:43.606743+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:43.606743+0000","last_undegraded":"2024-09-16T17:01:43.606743+0000","last_fullsized":"2024-09-16T17:01:43.606743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'892","reported_seq":916,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.373510+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:43.373510+0000","last_peered":"2024-09-16T17:01:43.373510+0000","last_clean":"2024-09-16T17:01:43.373510+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:43.373510+0000","last_undegraded":"2024-09-16T17:01:43.373510+0000","last_fullsized":"2024-09-16T17:01:43.373510+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'849","reported_seq":873,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.315246+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:43.315246+0000","last_peered":"2024-09-16T17:01:43.315246+0000","last_clean":"2024-09-16T17:01:43.315246+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:43.315246+0000","last_undegraded":"2024-09-16T17:01:43.315246+0000","last_fullsized":"2024-09-16T17:01:43.315246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'982","reported_seq":1006,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.672579+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:43.672579+0000","last_peered":"2024-09-16T17:01:43.672579+0000","last_clean":"2024-09-16T17:01:43.672579+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:43.672579+0000","last_undegraded":"2024-09-16T17:01:43.672579+0000","last_fullsized":"2024-09-16T17:01:43.672579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'877","reported_seq":901,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.247019+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:43.247019+0000","last_peered":"2024-09-16T17:01:43.247019+0000","last_clean":"2024-09-16T17:01:43.247019+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:43.247019+0000","last_undegraded":"2024-09-16T17:01:43.247019+0000","last_fullsized":"2024-09-16T17:01:43.247019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'912","reported_seq":936,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.517402+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:43.517402+0000","last_peered":"2024-09-16T17:01:43.517402+0000","last_clean":"2024-09-16T17:01:43.517402+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:43.517402+0000","last_undegraded":"2024-09-16T17:01:43.517402+0000","last_fullsized":"2024-09-16T17:01:43.517402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":297467928,"num_objects":4540,"num_object_clones":0,"num_object_copies":13620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14304,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14304,"ondisk_log_size":14304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":561464,"kb_used_data":561464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51736264,"statfs":{"total":53552873472,"available":52977934336,"internally_reserved":0,"allocated":574939136,"data_stored":574939136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":335920,"kb_used_data":335920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961808,"statfs":{"total":53552873472,"available":53208891392,"internally_reserved":0,"allocated":343982080,"data_stored":343982080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":487416,"kb_used_data":487416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51810312,"statfs":{"total":53552873472,"available":53053759488,"internally_reserved":0,"allocated":499113984,"data_stored":499113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416416,"kb_used_data":416416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51881312,"statfs":{"total":53552873472,"available":53126463488,"internally_reserved":0,"allocated":426409984,"data_stored":426409984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:56.629 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:01:56.629 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:56.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:56.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:56.768+0000 7fcb34191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:56.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:56.781+0000 7fcb34191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:01:57.008 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:01:57.022 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-16T17:01:55.949002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":298058315,"num_objects":4544,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14385,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14359,"ondisk_log_size":14359,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1801216,"kb_used_data":1801216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207389696,"statfs":{"total":214211493888,"available":212367048704,"internally_reserved":0,"allocated":1844445184,"data_stored":1844445184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000808"},"pg_stats":[{"pgid":"7.f","version":"92'923","reported_seq":947,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.340166+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:43.340166+0000","last_peered":"2024-09-16T17:01:43.340166+0000","last_clean":"2024-09-16T17:01:43.340166+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:43.340166+0000","last_undegraded":"2024-09-16T17:01:43.340166+0000","last_fullsized":"2024-09-16T17:01:43.340166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'858","reported_seq":882,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.673206+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:43.673206+0000","last_peered":"2024-09-16T17:01:43.673206+0000","last_clean":"2024-09-16T17:01:43.673206+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:43.673206+0000","last_undegraded":"2024-09-16T17:01:43.673206+0000","last_fullsized":"2024-09-16T17:01:43.673206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'912","reported_seq":937,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.820477+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:43.820477+0000","last_peered":"2024-09-16T17:01:43.820477+0000","last_clean":"2024-09-16T17:01:43.820477+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:43.820477+0000","last_undegraded":"2024-09-16T17:01:43.820477+0000","last_fullsized":"2024-09-16T17:01:43.820477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153496,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":912,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'896","reported_seq":920,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.707745+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:43.707745+0000","last_peered":"2024-09-16T17:01:43.707745+0000","last_clean":"2024-09-16T17:01:43.707745+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:43.707745+0000","last_undegraded":"2024-09-16T17:01:43.707745+0000","last_fullsized":"2024-09-16T17:01:43.707745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'848","reported_seq":872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.595403+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:43.595403+0000","last_peered":"2024-09-16T17:01:43.595403+0000","last_clean":"2024-09-16T17:01:43.595403+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:43.595403+0000","last_undegraded":"2024-09-16T17:01:43.595403+0000","last_fullsized":"2024-09-16T17:01:43.595403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'884","reported_seq":908,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.718533+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:43.718533+0000","last_peered":"2024-09-16T17:01:43.718533+0000","last_clean":"2024-09-16T17:01:43.718533+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:43.718533+0000","last_undegraded":"2024-09-16T17:01:43.718533+0000","last_fullsized":"2024-09-16T17:01:43.718533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'907","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.813597+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:43.813597+0000","last_peered":"2024-09-16T17:01:43.813597+0000","last_clean":"2024-09-16T17:01:43.813597+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:43.813597+0000","last_undegraded":"2024-09-16T17:01:43.813597+0000","last_fullsized":"2024-09-16T17:01:43.813597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":907,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'874","reported_seq":898,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.293132+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:43.293132+0000","last_peered":"2024-09-16T17:01:43.293132+0000","last_clean":"2024-09-16T17:01:43.293132+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:43.293132+0000","last_undegraded":"2024-09-16T17:01:43.293132+0000","last_fullsized":"2024-09-16T17:01:43.293132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'915","reported_seq":939,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.675270+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:43.675270+0000","last_peered":"2024-09-16T17:01:43.675270+0000","last_clean":"2024-09-16T17:01:43.675270+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:43.675270+0000","last_undegraded":"2024-09-16T17:01:43.675270+0000","last_fullsized":"2024-09-16T17:01:43.675270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'876","reported_seq":900,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.660361+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:43.660361+0000","last_peered":"2024-09-16T17:01:43.660361+0000","last_clean":"2024-09-16T17:01:43.660361+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:43.660361+0000","last_undegraded":"2024-09-16T17:01:43.660361+0000","last_fullsized":"2024-09-16T17:01:43.660361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'899","reported_seq":923,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.606743+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:43.606743+0000","last_peered":"2024-09-16T17:01:43.606743+0000","last_clean":"2024-09-16T17:01:43.606743+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:43.606743+0000","last_undegraded":"2024-09-16T17:01:43.606743+0000","last_fullsized":"2024-09-16T17:01:43.606743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'892","reported_seq":916,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.373510+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:43.373510+0000","last_peered":"2024-09-16T17:01:43.373510+0000","last_clean":"2024-09-16T17:01:43.373510+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:43.373510+0000","last_undegraded":"2024-09-16T17:01:43.373510+0000","last_fullsized":"2024-09-16T17:01:43.373510+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'849","reported_seq":873,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.315246+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:43.315246+0000","last_peered":"2024-09-16T17:01:43.315246+0000","last_clean":"2024-09-16T17:01:43.315246+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:43.315246+0000","last_undegraded":"2024-09-16T17:01:43.315246+0000","last_fullsized":"2024-09-16T17:01:43.315246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'982","reported_seq":1006,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.672579+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:43.672579+0000","last_peered":"2024-09-16T17:01:43.672579+0000","last_clean":"2024-09-16T17:01:43.672579+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:43.672579+0000","last_undegraded":"2024-09-16T17:01:43.672579+0000","last_fullsized":"2024-09-16T17:01:43.672579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'877","reported_seq":901,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.247019+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:43.247019+0000","last_peered":"2024-09-16T17:01:43.247019+0000","last_clean":"2024-09-16T17:01:43.247019+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:43.247019+0000","last_undegraded":"2024-09-16T17:01:43.247019+0000","last_fullsized":"2024-09-16T17:01:43.247019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'912","reported_seq":936,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.517402+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:43.517402+0000","last_peered":"2024-09-16T17:01:43.517402+0000","last_clean":"2024-09-16T17:01:43.517402+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:43.517402+0000","last_undegraded":"2024-09-16T17:01:43.517402+0000","last_fullsized":"2024-09-16T17:01:43.517402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":297467928,"num_objects":4540,"num_object_clones":0,"num_object_copies":13620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14304,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14304,"ondisk_log_size":14304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":561464,"kb_used_data":561464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51736264,"statfs":{"total":53552873472,"available":52977934336,"internally_reserved":0,"allocated":574939136,"data_stored":574939136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":335920,"kb_used_data":335920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961808,"statfs":{"total":53552873472,"available":53208891392,"internally_reserved":0,"allocated":343982080,"data_stored":343982080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":487416,"kb_used_data":487416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51810312,"statfs":{"total":53552873472,"available":53053759488,"internally_reserved":0,"allocated":499113984,"data_stored":499113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416416,"kb_used_data":416416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51881312,"statfs":{"total":53552873472,"available":53126463488,"internally_reserved":0,"allocated":426409984,"data_stored":426409984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:57.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:57.758+0000 7f48d5897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:01:57.766+0000 7f48d5897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:00.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:00.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:00.227+0000 7f04a8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:00.234+0000 7f04a8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:02:02.024 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:02:02.024 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:02:02.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:02:02.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.153+0000 7f2c11f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.166+0000 7f2c11f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:02.190 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:02.191 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:02.194 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:02.195 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:02.195 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:02:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.318+0000 7f4b11497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.330+0000 7f4b11497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:02.347 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:02.348 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:02.348 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:02.350 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:02.350 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:02.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:02:02.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.473+0000 7f7180951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:02.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.484+0000 7f7180951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:02.526 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:02.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:02.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:02.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:02:02.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.617+0000 7ff268f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.624+0000 7ff268f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.716+0000 7f73de04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:02.728+0000 7f73de04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:02.835 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:02.836 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:05.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:05.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:05.122+0000 7fefa5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:05.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:05.129+0000 7fefa5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:07.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:07.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:07.430+0000 7f1dabae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:07.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:07.437+0000 7f1dabae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:07.836 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:02:07.837 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:02:07.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:07.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:07.971+0000 7ff909151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:07.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:07.983+0000 7ff909151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:08.312 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:08.313 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:08.326 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-16T17:02:07.951536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":298058315,"num_objects":4544,"num_object_clones":0,"num_object_copies":13632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14385,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14359,"ondisk_log_size":14359,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":1801216,"kb_used_data":1801216,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":207389696,"statfs":{"total":214211493888,"available":212367048704,"internally_reserved":0,"allocated":1844445184,"data_stored":1844445184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002534"},"pg_stats":[{"pgid":"7.f","version":"92'923","reported_seq":947,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.340166+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:01:43.340166+0000","last_peered":"2024-09-16T17:01:43.340166+0000","last_clean":"2024-09-16T17:01:43.340166+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:01:43.340166+0000","last_undegraded":"2024-09-16T17:01:43.340166+0000","last_fullsized":"2024-09-16T17:01:43.340166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":923,"log_dups_size":0,"ondisk_log_size":923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":923,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"92'858","reported_seq":882,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.673206+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:01:43.673206+0000","last_peered":"2024-09-16T17:01:43.673206+0000","last_clean":"2024-09-16T17:01:43.673206+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:01:43.673206+0000","last_undegraded":"2024-09-16T17:01:43.673206+0000","last_fullsized":"2024-09-16T17:01:43.673206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"92'912","reported_seq":937,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.820477+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:01:43.820477+0000","last_peered":"2024-09-16T17:01:43.820477+0000","last_clean":"2024-09-16T17:01:43.820477+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:01:43.820477+0000","last_undegraded":"2024-09-16T17:01:43.820477+0000","last_fullsized":"2024-09-16T17:01:43.820477+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18153496,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":912,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"92'896","reported_seq":920,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.707745+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:01:43.707745+0000","last_peered":"2024-09-16T17:01:43.707745+0000","last_clean":"2024-09-16T17:01:43.707745+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:01:43.707745+0000","last_undegraded":"2024-09-16T17:01:43.707745+0000","last_fullsized":"2024-09-16T17:01:43.707745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"92'848","reported_seq":872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.595403+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:01:43.595403+0000","last_peered":"2024-09-16T17:01:43.595403+0000","last_clean":"2024-09-16T17:01:43.595403+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:01:43.595403+0000","last_undegraded":"2024-09-16T17:01:43.595403+0000","last_fullsized":"2024-09-16T17:01:43.595403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"92'884","reported_seq":908,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.718533+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:01:43.718533+0000","last_peered":"2024-09-16T17:01:43.718533+0000","last_clean":"2024-09-16T17:01:43.718533+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:01:43.718533+0000","last_undegraded":"2024-09-16T17:01:43.718533+0000","last_fullsized":"2024-09-16T17:01:43.718533+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":884,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"92'907","reported_seq":931,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.813597+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:01:43.813597+0000","last_peered":"2024-09-16T17:01:43.813597+0000","last_clean":"2024-09-16T17:01:43.813597+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:01:43.813597+0000","last_undegraded":"2024-09-16T17:01:43.813597+0000","last_fullsized":"2024-09-16T17:01:43.813597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":907,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"92'874","reported_seq":898,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.293132+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:01:43.293132+0000","last_peered":"2024-09-16T17:01:43.293132+0000","last_clean":"2024-09-16T17:01:43.293132+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:01:43.293132+0000","last_undegraded":"2024-09-16T17:01:43.293132+0000","last_fullsized":"2024-09-16T17:01:43.293132+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"92'915","reported_seq":939,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.675270+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:01:43.675270+0000","last_peered":"2024-09-16T17:01:43.675270+0000","last_clean":"2024-09-16T17:01:43.675270+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:01:43.675270+0000","last_undegraded":"2024-09-16T17:01:43.675270+0000","last_fullsized":"2024-09-16T17:01:43.675270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":316,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.863089+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:00:10.863089+0000","last_peered":"2024-09-16T17:00:10.863089+0000","last_clean":"2024-09-16T17:00:10.863089+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:00:10.863089+0000","last_undegraded":"2024-09-16T17:00:10.863089+0000","last_fullsized":"2024-09-16T17:00:10.863089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.867489+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:00:10.867489+0000","last_peered":"2024-09-16T17:00:10.867489+0000","last_clean":"2024-09-16T17:00:10.867489+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:00:10.867489+0000","last_undegraded":"2024-09-16T17:00:10.867489+0000","last_fullsized":"2024-09-16T17:00:10.867489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"92'876","reported_seq":900,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.660361+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:01:43.660361+0000","last_peered":"2024-09-16T17:01:43.660361+0000","last_clean":"2024-09-16T17:01:43.660361+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:01:43.660361+0000","last_undegraded":"2024-09-16T17:01:43.660361+0000","last_fullsized":"2024-09-16T17:01:43.660361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.999942+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:00:10.999942+0000","last_peered":"2024-09-16T17:00:10.999942+0000","last_clean":"2024-09-16T17:00:10.999942+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:00:10.999942+0000","last_undegraded":"2024-09-16T17:00:10.999942+0000","last_fullsized":"2024-09-16T17:00:10.999942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"92'899","reported_seq":923,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.606743+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:01:43.606743+0000","last_peered":"2024-09-16T17:01:43.606743+0000","last_clean":"2024-09-16T17:01:43.606743+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:01:43.606743+0000","last_undegraded":"2024-09-16T17:01:43.606743+0000","last_fullsized":"2024-09-16T17:01:43.606743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.861471+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:00:10.861471+0000","last_peered":"2024-09-16T17:00:10.861471+0000","last_clean":"2024-09-16T17:00:10.861471+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:00:10.861471+0000","last_undegraded":"2024-09-16T17:00:10.861471+0000","last_fullsized":"2024-09-16T17:00:10.861471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"92'892","reported_seq":916,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.373510+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:01:43.373510+0000","last_peered":"2024-09-16T17:01:43.373510+0000","last_clean":"2024-09-16T17:01:43.373510+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:01:43.373510+0000","last_undegraded":"2024-09-16T17:01:43.373510+0000","last_fullsized":"2024-09-16T17:01:43.373510+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267584,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":246,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:11.000183+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:00:11.000183+0000","last_peered":"2024-09-16T17:00:11.000183+0000","last_clean":"2024-09-16T17:00:11.000183+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:00:11.000183+0000","last_undegraded":"2024-09-16T17:00:11.000183+0000","last_fullsized":"2024-09-16T17:00:11.000183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"92'849","reported_seq":873,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.315246+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:01:43.315246+0000","last_peered":"2024-09-16T17:01:43.315246+0000","last_clean":"2024-09-16T17:01:43.315246+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:01:43.315246+0000","last_undegraded":"2024-09-16T17:01:43.315246+0000","last_fullsized":"2024-09-16T17:01:43.315246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872442+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:00:10.872442+0000","last_peered":"2024-09-16T17:00:10.872442+0000","last_clean":"2024-09-16T17:00:10.872442+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:00:10.872442+0000","last_undegraded":"2024-09-16T17:00:10.872442+0000","last_fullsized":"2024-09-16T17:00:10.872442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"92'982","reported_seq":1006,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.672579+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:01:43.672579+0000","last_peered":"2024-09-16T17:01:43.672579+0000","last_clean":"2024-09-16T17:01:43.672579+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:01:43.672579+0000","last_undegraded":"2024-09-16T17:01:43.672579+0000","last_fullsized":"2024-09-16T17:01:43.672579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.872156+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:00:10.872156+0000","last_peered":"2024-09-16T17:00:10.872156+0000","last_clean":"2024-09-16T17:00:10.872156+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:00:10.872156+0000","last_undegraded":"2024-09-16T17:00:10.872156+0000","last_fullsized":"2024-09-16T17:00:10.872156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"92'877","reported_seq":901,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.247019+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:01:43.247019+0000","last_peered":"2024-09-16T17:01:43.247019+0000","last_clean":"2024-09-16T17:01:43.247019+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:01:43.247019+0000","last_undegraded":"2024-09-16T17:01:43.247019+0000","last_fullsized":"2024-09-16T17:01:43.247019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.871374+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:00:10.871374+0000","last_peered":"2024-09-16T17:00:10.871374+0000","last_clean":"2024-09-16T17:00:10.871374+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:00:10.871374+0000","last_undegraded":"2024-09-16T17:00:10.871374+0000","last_fullsized":"2024-09-16T17:00:10.871374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"92'912","reported_seq":936,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:01:43.517402+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:01:43.517402+0000","last_peered":"2024-09-16T17:01:43.517402+0000","last_clean":"2024-09-16T17:01:43.517402+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:01:43.517402+0000","last_undegraded":"2024-09-16T17:01:43.517402+0000","last_fullsized":"2024-09-16T17:01:43.517402+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-16T17:00:10.868923+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:00:10.868923+0000","last_peered":"2024-09-16T17:00:10.868923+0000","last_clean":"2024-09-16T17:00:10.868923+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:00:10.868923+0000","last_undegraded":"2024-09-16T17:00:10.868923+0000","last_fullsized":"2024-09-16T17:00:10.868923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":297467928,"num_objects":4540,"num_object_clones":0,"num_object_copies":13620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14304,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14304,"ondisk_log_size":14304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":212378529792,"internally_reserved":0,"allocated":1832964096,"data_stored":1832964096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":561464,"kb_used_data":561464,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51736264,"statfs":{"total":53552873472,"available":52977934336,"internally_reserved":0,"allocated":574939136,"data_stored":574939136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":335920,"kb_used_data":335920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51961808,"statfs":{"total":53552873472,"available":53208891392,"internally_reserved":0,"allocated":343982080,"data_stored":343982080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":487416,"kb_used_data":487416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51810312,"statfs":{"total":53552873472,"available":53053759488,"internally_reserved":0,"allocated":499113984,"data_stored":499113984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":416416,"kb_used_data":416416,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":51881312,"statfs":{"total":53552873472,"available":53126463488,"internally_reserved":0,"allocated":426409984,"data_stored":426409984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":52979507200,"internally_reserved":0,"allocated":573366272,"data_stored":573366272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53130563584,"internally_reserved":0,"allocated":422309888,"data_stored":422309888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53054025728,"internally_reserved":0,"allocated":498847744,"data_stored":498847744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53214302208,"internally_reserved":0,"allocated":338571264,"data_stored":338571264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":52979638272,"internally_reserved":0,"allocated":573235200,"data_stored":573235200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:09.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:09.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:09.828+0000 7f7dc2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:09.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:09.833+0000 7f7dc2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:11.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:12.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:12.130+0000 7f9786e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:12.136+0000 7f9786e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:13.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:02:13.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:02:13.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:13.480+0000 7f92ba391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:13.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:13.495+0000 7f92ba391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:02:13.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:02:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:13.976+0000 7f7bc4f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:13.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:13.992+0000 7f7bc4f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:14.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:14.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:14.588+0000 7f1ec7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:14.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:14.595+0000 7f1ec7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:02:14.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:02:15.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:14.991+0000 7f4497551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:15.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:15.007+0000 7f4497551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:15.816 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:02:15.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:02:15.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:15.977+0000 7f35a0b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:15.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:15.989+0000 7f35a0b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:16.820 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:02:16.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:02:16.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:16.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:17.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.022+0000 7fe585b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.038+0000 7fe585b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.114+0000 7f6354591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.122+0000 7f6354591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:17.384 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-16T17:02:16.821105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115868235,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17165,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17139,"ondisk_log_size":17139,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":731228,"kb_used_data":731228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208459684,"statfs":{"total":214211493888,"available":213462716416,"internally_reserved":0,"allocated":748777472,"data_stored":748777472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-182190080,"num_objects":-2780,"num_object_clones":0,"num_object_copies":-8340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868679"},"pg_stats":[{"pgid":"7.f","version":"96'1113","reported_seq":1152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.861184+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:02:13.861184+0000","last_peered":"2024-09-16T17:02:13.861184+0000","last_clean":"2024-09-16T17:02:13.861184+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:02:13.861184+0000","last_undegraded":"2024-09-16T17:02:13.861184+0000","last_fullsized":"2024-09-16T17:02:13.861184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1050","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.546708+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:02:13.546708+0000","last_peered":"2024-09-16T17:02:13.546708+0000","last_clean":"2024-09-16T17:02:13.546708+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:02:13.546708+0000","last_undegraded":"2024-09-16T17:02:13.546708+0000","last_fullsized":"2024-09-16T17:02:13.546708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'1089","reported_seq":1129,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.904130+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:02:13.904130+0000","last_peered":"2024-09-16T17:02:13.904130+0000","last_clean":"2024-09-16T17:02:13.904130+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:02:13.904130+0000","last_undegraded":"2024-09-16T17:02:13.904130+0000","last_fullsized":"2024-09-16T17:02:13.904130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553624,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1089,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'1063","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.839328+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:02:13.839328+0000","last_peered":"2024-09-16T17:02:13.839328+0000","last_clean":"2024-09-16T17:02:13.839328+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:02:13.839328+0000","last_undegraded":"2024-09-16T17:02:13.839328+0000","last_fullsized":"2024-09-16T17:02:13.839328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1021","reported_seq":1060,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.869660+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:02:13.869660+0000","last_peered":"2024-09-16T17:02:13.869660+0000","last_clean":"2024-09-16T17:02:13.869660+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:02:13.869660+0000","last_undegraded":"2024-09-16T17:02:13.869660+0000","last_fullsized":"2024-09-16T17:02:13.869660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1065","reported_seq":1103,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867599+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:02:13.867599+0000","last_peered":"2024-09-16T17:02:13.867599+0000","last_clean":"2024-09-16T17:02:13.867599+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:02:13.867599+0000","last_undegraded":"2024-09-16T17:02:13.867599+0000","last_fullsized":"2024-09-16T17:02:13.867599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'1091","reported_seq":1130,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.927287+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:02:13.927287+0000","last_peered":"2024-09-16T17:02:13.927287+0000","last_clean":"2024-09-16T17:02:13.927287+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:02:13.927287+0000","last_undegraded":"2024-09-16T17:02:13.927287+0000","last_fullsized":"2024-09-16T17:02:13.927287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1029","reported_seq":1065,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.715866+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:02:13.715866+0000","last_peered":"2024-09-16T17:02:13.715866+0000","last_clean":"2024-09-16T17:02:13.715866+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:02:13.715866+0000","last_undegraded":"2024-09-16T17:02:13.715866+0000","last_fullsized":"2024-09-16T17:02:13.715866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1068","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.866498+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:02:13.866498+0000","last_peered":"2024-09-16T17:02:13.866498+0000","last_clean":"2024-09-16T17:02:13.866498+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:02:13.866498+0000","last_undegraded":"2024-09-16T17:02:13.866498+0000","last_fullsized":"2024-09-16T17:02:13.866498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.864119+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:13.864119+0000","last_peered":"2024-09-16T17:02:13.864119+0000","last_clean":"2024-09-16T17:02:13.864119+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:13.864119+0000","last_undegraded":"2024-09-16T17:02:13.864119+0000","last_fullsized":"2024-09-16T17:02:13.864119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.868194+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:01:55.868194+0000","last_peered":"2024-09-16T17:01:55.868194+0000","last_clean":"2024-09-16T17:01:55.868194+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:01:55.868194+0000","last_undegraded":"2024-09-16T17:01:55.868194+0000","last_fullsized":"2024-09-16T17:01:55.868194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1039","reported_seq":1075,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.491090+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:02:13.491090+0000","last_peered":"2024-09-16T17:02:13.491090+0000","last_clean":"2024-09-16T17:02:13.491090+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:02:13.491090+0000","last_undegraded":"2024-09-16T17:02:13.491090+0000","last_fullsized":"2024-09-16T17:02:13.491090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.698876+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:00.698876+0000","last_peered":"2024-09-16T17:02:00.698876+0000","last_clean":"2024-09-16T17:02:00.698876+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:00.698876+0000","last_undegraded":"2024-09-16T17:02:00.698876+0000","last_fullsized":"2024-09-16T17:02:00.698876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1081","reported_seq":1120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.837844+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:02:13.837844+0000","last_peered":"2024-09-16T17:02:13.837844+0000","last_clean":"2024-09-16T17:02:13.837844+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:02:13.837844+0000","last_undegraded":"2024-09-16T17:02:13.837844+0000","last_fullsized":"2024-09-16T17:02:13.837844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1081,"log_dups_size":0,"ondisk_log_size":1081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.857599+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:01:55.857599+0000","last_peered":"2024-09-16T17:01:55.857599+0000","last_clean":"2024-09-16T17:01:55.857599+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:01:55.857599+0000","last_undegraded":"2024-09-16T17:01:55.857599+0000","last_fullsized":"2024-09-16T17:01:55.857599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1084","reported_seq":1120,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.747534+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:02:13.747534+0000","last_peered":"2024-09-16T17:02:13.747534+0000","last_clean":"2024-09-16T17:02:13.747534+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:02:13.747534+0000","last_undegraded":"2024-09-16T17:02:13.747534+0000","last_fullsized":"2024-09-16T17:02:13.747534+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.697611+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:00.697611+0000","last_peered":"2024-09-16T17:02:00.697611+0000","last_clean":"2024-09-16T17:02:00.697611+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:00.697611+0000","last_undegraded":"2024-09-16T17:02:00.697611+0000","last_fullsized":"2024-09-16T17:02:00.697611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1030","reported_seq":1066,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.417399+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:02:13.417399+0000","last_peered":"2024-09-16T17:02:13.417399+0000","last_clean":"2024-09-16T17:02:13.417399+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:02:13.417399+0000","last_undegraded":"2024-09-16T17:02:13.417399+0000","last_fullsized":"2024-09-16T17:02:13.417399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.841633+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:13.841633+0000","last_peered":"2024-09-16T17:02:13.841633+0000","last_clean":"2024-09-16T17:02:13.841633+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:13.841633+0000","last_undegraded":"2024-09-16T17:02:13.841633+0000","last_fullsized":"2024-09-16T17:02:13.841633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'1151","reported_seq":1190,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.832719+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:02:13.832719+0000","last_peered":"2024-09-16T17:02:13.832719+0000","last_clean":"2024-09-16T17:02:13.832719+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:02:13.832719+0000","last_undegraded":"2024-09-16T17:02:13.832719+0000","last_fullsized":"2024-09-16T17:02:13.832719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868838+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:13.868838+0000","last_peered":"2024-09-16T17:02:13.868838+0000","last_clean":"2024-09-16T17:02:13.868838+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:13.868838+0000","last_undegraded":"2024-09-16T17:02:13.868838+0000","last_fullsized":"2024-09-16T17:02:13.868838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1030","reported_seq":1069,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867330+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:02:13.867330+0000","last_peered":"2024-09-16T17:02:13.867330+0000","last_clean":"2024-09-16T17:02:13.867330+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:02:13.867330+0000","last_undegraded":"2024-09-16T17:02:13.867330+0000","last_fullsized":"2024-09-16T17:02:13.867330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.840482+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:13.840482+0000","last_peered":"2024-09-16T17:02:13.840482+0000","last_clean":"2024-09-16T17:02:13.840482+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:13.840482+0000","last_undegraded":"2024-09-16T17:02:13.840482+0000","last_fullsized":"2024-09-16T17:02:13.840482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1080","reported_seq":1119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868947+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:02:13.868947+0000","last_peered":"2024-09-16T17:02:13.868947+0000","last_clean":"2024-09-16T17:02:13.868947+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:02:13.868947+0000","last_undegraded":"2024-09-16T17:02:13.868947+0000","last_fullsized":"2024-09-16T17:02:13.868947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.871106+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:01:55.871106+0000","last_peered":"2024-09-16T17:01:55.871106+0000","last_clean":"2024-09-16T17:01:55.871106+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:01:55.871106+0000","last_undegraded":"2024-09-16T17:01:55.871106+0000","last_fullsized":"2024-09-16T17:01:55.871106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":115277848,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17084,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213475450880,"internally_reserved":0,"allocated":736043008,"data_stored":736043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213474922496,"internally_reserved":0,"allocated":736571392,"data_stored":736571392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229116,"kb_used_data":229116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068612,"statfs":{"total":53552873472,"available":53318258688,"internally_reserved":0,"allocated":234614784,"data_stored":234614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":133716,"kb_used_data":133716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52164012,"statfs":{"total":53552873472,"available":53415948288,"internally_reserved":0,"allocated":136925184,"data_stored":136925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197548,"kb_used_data":197548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52100180,"statfs":{"total":53552873472,"available":53350584320,"internally_reserved":0,"allocated":202289152,"data_stored":202289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":170848,"kb_used_data":170848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52126880,"statfs":{"total":53552873472,"available":53377925120,"internally_reserved":0,"allocated":174948352,"data_stored":174948352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53383110656,"internally_reserved":0,"allocated":169762816,"data_stored":169762816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53351129088,"internally_reserved":0,"allocated":201744384,"data_stored":201744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420953600,"internally_reserved":0,"allocated":131919872,"data_stored":131919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53383241728,"internally_reserved":0,"allocated":169631744,"data_stored":169631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53351264256,"internally_reserved":0,"allocated":201609216,"data_stored":201609216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53421084672,"internally_reserved":0,"allocated":131788800,"data_stored":131788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53319860224,"internally_reserved":0,"allocated":233013248,"data_stored":233013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:17.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:17.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.536+0000 7fcfa4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:17.549+0000 7fcfa4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:17.863 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:17.879 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-16T17:02:16.821105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115868235,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17165,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17139,"ondisk_log_size":17139,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":731228,"kb_used_data":731228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208459684,"statfs":{"total":214211493888,"available":213462716416,"internally_reserved":0,"allocated":748777472,"data_stored":748777472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-182190080,"num_objects":-2780,"num_object_clones":0,"num_object_copies":-8340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2780,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868679"},"pg_stats":[{"pgid":"7.f","version":"96'1113","reported_seq":1152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.861184+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:02:13.861184+0000","last_peered":"2024-09-16T17:02:13.861184+0000","last_clean":"2024-09-16T17:02:13.861184+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:02:13.861184+0000","last_undegraded":"2024-09-16T17:02:13.861184+0000","last_fullsized":"2024-09-16T17:02:13.861184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1050","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.546708+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:02:13.546708+0000","last_peered":"2024-09-16T17:02:13.546708+0000","last_clean":"2024-09-16T17:02:13.546708+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:02:13.546708+0000","last_undegraded":"2024-09-16T17:02:13.546708+0000","last_fullsized":"2024-09-16T17:02:13.546708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'1089","reported_seq":1129,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.904130+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:02:13.904130+0000","last_peered":"2024-09-16T17:02:13.904130+0000","last_clean":"2024-09-16T17:02:13.904130+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:02:13.904130+0000","last_undegraded":"2024-09-16T17:02:13.904130+0000","last_fullsized":"2024-09-16T17:02:13.904130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553624,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1089,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'1063","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.839328+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:02:13.839328+0000","last_peered":"2024-09-16T17:02:13.839328+0000","last_clean":"2024-09-16T17:02:13.839328+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:02:13.839328+0000","last_undegraded":"2024-09-16T17:02:13.839328+0000","last_fullsized":"2024-09-16T17:02:13.839328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1021","reported_seq":1060,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.869660+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:02:13.869660+0000","last_peered":"2024-09-16T17:02:13.869660+0000","last_clean":"2024-09-16T17:02:13.869660+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:02:13.869660+0000","last_undegraded":"2024-09-16T17:02:13.869660+0000","last_fullsized":"2024-09-16T17:02:13.869660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1065","reported_seq":1103,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867599+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:02:13.867599+0000","last_peered":"2024-09-16T17:02:13.867599+0000","last_clean":"2024-09-16T17:02:13.867599+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:02:13.867599+0000","last_undegraded":"2024-09-16T17:02:13.867599+0000","last_fullsized":"2024-09-16T17:02:13.867599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'1091","reported_seq":1130,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.927287+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:02:13.927287+0000","last_peered":"2024-09-16T17:02:13.927287+0000","last_clean":"2024-09-16T17:02:13.927287+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:02:13.927287+0000","last_undegraded":"2024-09-16T17:02:13.927287+0000","last_fullsized":"2024-09-16T17:02:13.927287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1029","reported_seq":1065,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.715866+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:02:13.715866+0000","last_peered":"2024-09-16T17:02:13.715866+0000","last_clean":"2024-09-16T17:02:13.715866+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:02:13.715866+0000","last_undegraded":"2024-09-16T17:02:13.715866+0000","last_fullsized":"2024-09-16T17:02:13.715866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1068","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.866498+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:02:13.866498+0000","last_peered":"2024-09-16T17:02:13.866498+0000","last_clean":"2024-09-16T17:02:13.866498+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:02:13.866498+0000","last_undegraded":"2024-09-16T17:02:13.866498+0000","last_fullsized":"2024-09-16T17:02:13.866498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.864119+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:13.864119+0000","last_peered":"2024-09-16T17:02:13.864119+0000","last_clean":"2024-09-16T17:02:13.864119+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:13.864119+0000","last_undegraded":"2024-09-16T17:02:13.864119+0000","last_fullsized":"2024-09-16T17:02:13.864119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.868194+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:01:55.868194+0000","last_peered":"2024-09-16T17:01:55.868194+0000","last_clean":"2024-09-16T17:01:55.868194+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:01:55.868194+0000","last_undegraded":"2024-09-16T17:01:55.868194+0000","last_fullsized":"2024-09-16T17:01:55.868194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1039","reported_seq":1075,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.491090+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:02:13.491090+0000","last_peered":"2024-09-16T17:02:13.491090+0000","last_clean":"2024-09-16T17:02:13.491090+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:02:13.491090+0000","last_undegraded":"2024-09-16T17:02:13.491090+0000","last_fullsized":"2024-09-16T17:02:13.491090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.698876+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:00.698876+0000","last_peered":"2024-09-16T17:02:00.698876+0000","last_clean":"2024-09-16T17:02:00.698876+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:00.698876+0000","last_undegraded":"2024-09-16T17:02:00.698876+0000","last_fullsized":"2024-09-16T17:02:00.698876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1081","reported_seq":1120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.837844+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:02:13.837844+0000","last_peered":"2024-09-16T17:02:13.837844+0000","last_clean":"2024-09-16T17:02:13.837844+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:02:13.837844+0000","last_undegraded":"2024-09-16T17:02:13.837844+0000","last_fullsized":"2024-09-16T17:02:13.837844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1081,"log_dups_size":0,"ondisk_log_size":1081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.857599+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:01:55.857599+0000","last_peered":"2024-09-16T17:01:55.857599+0000","last_clean":"2024-09-16T17:01:55.857599+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:01:55.857599+0000","last_undegraded":"2024-09-16T17:01:55.857599+0000","last_fullsized":"2024-09-16T17:01:55.857599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1084","reported_seq":1120,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.747534+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:02:13.747534+0000","last_peered":"2024-09-16T17:02:13.747534+0000","last_clean":"2024-09-16T17:02:13.747534+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:02:13.747534+0000","last_undegraded":"2024-09-16T17:02:13.747534+0000","last_fullsized":"2024-09-16T17:02:13.747534+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.697611+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:00.697611+0000","last_peered":"2024-09-16T17:02:00.697611+0000","last_clean":"2024-09-16T17:02:00.697611+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:00.697611+0000","last_undegraded":"2024-09-16T17:02:00.697611+0000","last_fullsized":"2024-09-16T17:02:00.697611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1030","reported_seq":1066,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.417399+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:02:13.417399+0000","last_peered":"2024-09-16T17:02:13.417399+0000","last_clean":"2024-09-16T17:02:13.417399+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:02:13.417399+0000","last_undegraded":"2024-09-16T17:02:13.417399+0000","last_fullsized":"2024-09-16T17:02:13.417399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.841633+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:13.841633+0000","last_peered":"2024-09-16T17:02:13.841633+0000","last_clean":"2024-09-16T17:02:13.841633+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:13.841633+0000","last_undegraded":"2024-09-16T17:02:13.841633+0000","last_fullsized":"2024-09-16T17:02:13.841633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'1151","reported_seq":1190,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.832719+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:02:13.832719+0000","last_peered":"2024-09-16T17:02:13.832719+0000","last_clean":"2024-09-16T17:02:13.832719+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:02:13.832719+0000","last_undegraded":"2024-09-16T17:02:13.832719+0000","last_fullsized":"2024-09-16T17:02:13.832719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868838+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:13.868838+0000","last_peered":"2024-09-16T17:02:13.868838+0000","last_clean":"2024-09-16T17:02:13.868838+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:13.868838+0000","last_undegraded":"2024-09-16T17:02:13.868838+0000","last_fullsized":"2024-09-16T17:02:13.868838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1030","reported_seq":1069,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867330+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:02:13.867330+0000","last_peered":"2024-09-16T17:02:13.867330+0000","last_clean":"2024-09-16T17:02:13.867330+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:02:13.867330+0000","last_undegraded":"2024-09-16T17:02:13.867330+0000","last_fullsized":"2024-09-16T17:02:13.867330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.840482+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:13.840482+0000","last_peered":"2024-09-16T17:02:13.840482+0000","last_clean":"2024-09-16T17:02:13.840482+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:13.840482+0000","last_undegraded":"2024-09-16T17:02:13.840482+0000","last_fullsized":"2024-09-16T17:02:13.840482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1080","reported_seq":1119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868947+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:02:13.868947+0000","last_peered":"2024-09-16T17:02:13.868947+0000","last_clean":"2024-09-16T17:02:13.868947+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:02:13.868947+0000","last_undegraded":"2024-09-16T17:02:13.868947+0000","last_fullsized":"2024-09-16T17:02:13.868947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.871106+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:01:55.871106+0000","last_peered":"2024-09-16T17:01:55.871106+0000","last_clean":"2024-09-16T17:01:55.871106+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:01:55.871106+0000","last_undegraded":"2024-09-16T17:01:55.871106+0000","last_fullsized":"2024-09-16T17:01:55.871106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":115277848,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17084,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213475450880,"internally_reserved":0,"allocated":736043008,"data_stored":736043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213474922496,"internally_reserved":0,"allocated":736571392,"data_stored":736571392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229116,"kb_used_data":229116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068612,"statfs":{"total":53552873472,"available":53318258688,"internally_reserved":0,"allocated":234614784,"data_stored":234614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":133716,"kb_used_data":133716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52164012,"statfs":{"total":53552873472,"available":53415948288,"internally_reserved":0,"allocated":136925184,"data_stored":136925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197548,"kb_used_data":197548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52100180,"statfs":{"total":53552873472,"available":53350584320,"internally_reserved":0,"allocated":202289152,"data_stored":202289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":170848,"kb_used_data":170848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52126880,"statfs":{"total":53552873472,"available":53377925120,"internally_reserved":0,"allocated":174948352,"data_stored":174948352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53383110656,"internally_reserved":0,"allocated":169762816,"data_stored":169762816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53351129088,"internally_reserved":0,"allocated":201744384,"data_stored":201744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420953600,"internally_reserved":0,"allocated":131919872,"data_stored":131919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53383241728,"internally_reserved":0,"allocated":169631744,"data_stored":169631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53351264256,"internally_reserved":0,"allocated":201609216,"data_stored":201609216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53421084672,"internally_reserved":0,"allocated":131788800,"data_stored":131788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53319860224,"internally_reserved":0,"allocated":233013248,"data_stored":233013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:17.881 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:02:17.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:02:17.881 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:02:17.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:02:18.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.037+0000 7f620b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.047+0000 7f620b111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:18.136 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:18.137 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:18.140 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:18.140 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:18.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:02:18.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.301+0000 7f322d2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.316+0000 7f322d2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:18.355 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:18.356 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:18.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:18.359 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:18.359 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:02:18.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.505+0000 7f9c41263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.520+0000 7f9c41263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:18.587 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:18.588 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:18.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:02:18.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.745+0000 7f0efae88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:18.759+0000 7f0efae88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:18.929 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:18.930 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:18.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:18.934 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:19.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:19.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:19.555+0000 7f4edaeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:19.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:19.564+0000 7f4edaeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:21.971 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:22.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:22.121+0000 7f4de6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:22.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:22.128+0000 7f4de6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:23.934 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:02:23.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:02:24.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:24.082+0000 7f908f074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:24.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:24.101+0000 7f908f074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:24.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:24.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:24.701+0000 7fd7fa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:24.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:24.711+0000 7fd7fa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:24.789 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:02:24.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:02:25.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:24.987+0000 7fe7def51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:25.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:25.005+0000 7fe7def51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:25.795 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:02:25.813 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:02:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:25.935+0000 7f29a469c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:25.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:25.959+0000 7f29a469c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:26.805 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:02:26.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:02:27.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:26.999+0000 7fd88524f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:27.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:27.016+0000 7fd88524f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:27.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:27.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:27.347+0000 7f59d9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:27.356+0000 7f59d9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:27.806 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:02:27.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:02:27.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:27.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:27.963+0000 7feac949c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:27.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:27.974+0000 7feac949c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:28.242 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:28.242 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:28.265 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2024-09-16T17:02:27.955792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115868235,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17165,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17139,"ondisk_log_size":17139,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":731228,"kb_used_data":731228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208459684,"statfs":{"total":214211493888,"available":213462716416,"internally_reserved":0,"allocated":748777472,"data_stored":748777472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000879"},"pg_stats":[{"pgid":"7.f","version":"96'1113","reported_seq":1152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.861184+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:02:13.861184+0000","last_peered":"2024-09-16T17:02:13.861184+0000","last_clean":"2024-09-16T17:02:13.861184+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:02:13.861184+0000","last_undegraded":"2024-09-16T17:02:13.861184+0000","last_fullsized":"2024-09-16T17:02:13.861184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1050","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.546708+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:02:13.546708+0000","last_peered":"2024-09-16T17:02:13.546708+0000","last_clean":"2024-09-16T17:02:13.546708+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:02:13.546708+0000","last_undegraded":"2024-09-16T17:02:13.546708+0000","last_fullsized":"2024-09-16T17:02:13.546708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'1089","reported_seq":1129,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.904130+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:02:13.904130+0000","last_peered":"2024-09-16T17:02:13.904130+0000","last_clean":"2024-09-16T17:02:13.904130+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:02:13.904130+0000","last_undegraded":"2024-09-16T17:02:13.904130+0000","last_fullsized":"2024-09-16T17:02:13.904130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553624,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1089,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'1063","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.839328+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:02:13.839328+0000","last_peered":"2024-09-16T17:02:13.839328+0000","last_clean":"2024-09-16T17:02:13.839328+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:02:13.839328+0000","last_undegraded":"2024-09-16T17:02:13.839328+0000","last_fullsized":"2024-09-16T17:02:13.839328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1021","reported_seq":1060,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.869660+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:02:13.869660+0000","last_peered":"2024-09-16T17:02:13.869660+0000","last_clean":"2024-09-16T17:02:13.869660+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:02:13.869660+0000","last_undegraded":"2024-09-16T17:02:13.869660+0000","last_fullsized":"2024-09-16T17:02:13.869660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1065","reported_seq":1103,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867599+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:02:13.867599+0000","last_peered":"2024-09-16T17:02:13.867599+0000","last_clean":"2024-09-16T17:02:13.867599+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:02:13.867599+0000","last_undegraded":"2024-09-16T17:02:13.867599+0000","last_fullsized":"2024-09-16T17:02:13.867599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'1091","reported_seq":1130,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.927287+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:02:13.927287+0000","last_peered":"2024-09-16T17:02:13.927287+0000","last_clean":"2024-09-16T17:02:13.927287+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:02:13.927287+0000","last_undegraded":"2024-09-16T17:02:13.927287+0000","last_fullsized":"2024-09-16T17:02:13.927287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1029","reported_seq":1065,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.715866+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:02:13.715866+0000","last_peered":"2024-09-16T17:02:13.715866+0000","last_clean":"2024-09-16T17:02:13.715866+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:02:13.715866+0000","last_undegraded":"2024-09-16T17:02:13.715866+0000","last_fullsized":"2024-09-16T17:02:13.715866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1068","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.866498+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:02:13.866498+0000","last_peered":"2024-09-16T17:02:13.866498+0000","last_clean":"2024-09-16T17:02:13.866498+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:02:13.866498+0000","last_undegraded":"2024-09-16T17:02:13.866498+0000","last_fullsized":"2024-09-16T17:02:13.866498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.864119+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:13.864119+0000","last_peered":"2024-09-16T17:02:13.864119+0000","last_clean":"2024-09-16T17:02:13.864119+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:13.864119+0000","last_undegraded":"2024-09-16T17:02:13.864119+0000","last_fullsized":"2024-09-16T17:02:13.864119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.868194+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:01:55.868194+0000","last_peered":"2024-09-16T17:01:55.868194+0000","last_clean":"2024-09-16T17:01:55.868194+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:01:55.868194+0000","last_undegraded":"2024-09-16T17:01:55.868194+0000","last_fullsized":"2024-09-16T17:01:55.868194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1039","reported_seq":1075,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.491090+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:02:13.491090+0000","last_peered":"2024-09-16T17:02:13.491090+0000","last_clean":"2024-09-16T17:02:13.491090+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:02:13.491090+0000","last_undegraded":"2024-09-16T17:02:13.491090+0000","last_fullsized":"2024-09-16T17:02:13.491090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.698876+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:00.698876+0000","last_peered":"2024-09-16T17:02:00.698876+0000","last_clean":"2024-09-16T17:02:00.698876+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:00.698876+0000","last_undegraded":"2024-09-16T17:02:00.698876+0000","last_fullsized":"2024-09-16T17:02:00.698876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1081","reported_seq":1120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.837844+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:02:13.837844+0000","last_peered":"2024-09-16T17:02:13.837844+0000","last_clean":"2024-09-16T17:02:13.837844+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:02:13.837844+0000","last_undegraded":"2024-09-16T17:02:13.837844+0000","last_fullsized":"2024-09-16T17:02:13.837844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1081,"log_dups_size":0,"ondisk_log_size":1081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.857599+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:01:55.857599+0000","last_peered":"2024-09-16T17:01:55.857599+0000","last_clean":"2024-09-16T17:01:55.857599+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:01:55.857599+0000","last_undegraded":"2024-09-16T17:01:55.857599+0000","last_fullsized":"2024-09-16T17:01:55.857599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1084","reported_seq":1120,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.747534+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:02:13.747534+0000","last_peered":"2024-09-16T17:02:13.747534+0000","last_clean":"2024-09-16T17:02:13.747534+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:02:13.747534+0000","last_undegraded":"2024-09-16T17:02:13.747534+0000","last_fullsized":"2024-09-16T17:02:13.747534+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.697611+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:00.697611+0000","last_peered":"2024-09-16T17:02:00.697611+0000","last_clean":"2024-09-16T17:02:00.697611+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:00.697611+0000","last_undegraded":"2024-09-16T17:02:00.697611+0000","last_fullsized":"2024-09-16T17:02:00.697611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1030","reported_seq":1066,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.417399+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:02:13.417399+0000","last_peered":"2024-09-16T17:02:13.417399+0000","last_clean":"2024-09-16T17:02:13.417399+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:02:13.417399+0000","last_undegraded":"2024-09-16T17:02:13.417399+0000","last_fullsized":"2024-09-16T17:02:13.417399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.841633+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:13.841633+0000","last_peered":"2024-09-16T17:02:13.841633+0000","last_clean":"2024-09-16T17:02:13.841633+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:13.841633+0000","last_undegraded":"2024-09-16T17:02:13.841633+0000","last_fullsized":"2024-09-16T17:02:13.841633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'1151","reported_seq":1190,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.832719+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:02:13.832719+0000","last_peered":"2024-09-16T17:02:13.832719+0000","last_clean":"2024-09-16T17:02:13.832719+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:02:13.832719+0000","last_undegraded":"2024-09-16T17:02:13.832719+0000","last_fullsized":"2024-09-16T17:02:13.832719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868838+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:13.868838+0000","last_peered":"2024-09-16T17:02:13.868838+0000","last_clean":"2024-09-16T17:02:13.868838+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:13.868838+0000","last_undegraded":"2024-09-16T17:02:13.868838+0000","last_fullsized":"2024-09-16T17:02:13.868838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1030","reported_seq":1069,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867330+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:02:13.867330+0000","last_peered":"2024-09-16T17:02:13.867330+0000","last_clean":"2024-09-16T17:02:13.867330+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:02:13.867330+0000","last_undegraded":"2024-09-16T17:02:13.867330+0000","last_fullsized":"2024-09-16T17:02:13.867330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.840482+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:13.840482+0000","last_peered":"2024-09-16T17:02:13.840482+0000","last_clean":"2024-09-16T17:02:13.840482+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:13.840482+0000","last_undegraded":"2024-09-16T17:02:13.840482+0000","last_fullsized":"2024-09-16T17:02:13.840482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1080","reported_seq":1119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868947+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:02:13.868947+0000","last_peered":"2024-09-16T17:02:13.868947+0000","last_clean":"2024-09-16T17:02:13.868947+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:02:13.868947+0000","last_undegraded":"2024-09-16T17:02:13.868947+0000","last_fullsized":"2024-09-16T17:02:13.868947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.871106+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:01:55.871106+0000","last_peered":"2024-09-16T17:01:55.871106+0000","last_clean":"2024-09-16T17:01:55.871106+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:01:55.871106+0000","last_undegraded":"2024-09-16T17:01:55.871106+0000","last_fullsized":"2024-09-16T17:01:55.871106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":115277848,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17084,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213475450880,"internally_reserved":0,"allocated":736043008,"data_stored":736043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213474922496,"internally_reserved":0,"allocated":736571392,"data_stored":736571392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229116,"kb_used_data":229116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068612,"statfs":{"total":53552873472,"available":53318258688,"internally_reserved":0,"allocated":234614784,"data_stored":234614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":133716,"kb_used_data":133716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52164012,"statfs":{"total":53552873472,"available":53415948288,"internally_reserved":0,"allocated":136925184,"data_stored":136925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197548,"kb_used_data":197548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52100180,"statfs":{"total":53552873472,"available":53350584320,"internally_reserved":0,"allocated":202289152,"data_stored":202289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":170848,"kb_used_data":170848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52126880,"statfs":{"total":53552873472,"available":53377925120,"internally_reserved":0,"allocated":174948352,"data_stored":174948352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53383110656,"internally_reserved":0,"allocated":169762816,"data_stored":169762816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53351129088,"internally_reserved":0,"allocated":201744384,"data_stored":201744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420953600,"internally_reserved":0,"allocated":131919872,"data_stored":131919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53383241728,"internally_reserved":0,"allocated":169631744,"data_stored":169631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53351264256,"internally_reserved":0,"allocated":201609216,"data_stored":201609216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53421084672,"internally_reserved":0,"allocated":131788800,"data_stored":131788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53319860224,"internally_reserved":0,"allocated":233013248,"data_stored":233013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:28.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:28.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:28.428+0000 7fb2a146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:28.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:28.442+0000 7fb2a146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:28.688 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:28.689 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:28.703 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2024-09-16T17:02:27.955792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115868235,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17165,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17139,"ondisk_log_size":17139,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":731228,"kb_used_data":731228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208459684,"statfs":{"total":214211493888,"available":213462716416,"internally_reserved":0,"allocated":748777472,"data_stored":748777472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000879"},"pg_stats":[{"pgid":"7.f","version":"96'1113","reported_seq":1152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.861184+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:02:13.861184+0000","last_peered":"2024-09-16T17:02:13.861184+0000","last_clean":"2024-09-16T17:02:13.861184+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:02:13.861184+0000","last_undegraded":"2024-09-16T17:02:13.861184+0000","last_fullsized":"2024-09-16T17:02:13.861184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1050","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.546708+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:02:13.546708+0000","last_peered":"2024-09-16T17:02:13.546708+0000","last_clean":"2024-09-16T17:02:13.546708+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:02:13.546708+0000","last_undegraded":"2024-09-16T17:02:13.546708+0000","last_fullsized":"2024-09-16T17:02:13.546708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'1089","reported_seq":1129,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.904130+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:02:13.904130+0000","last_peered":"2024-09-16T17:02:13.904130+0000","last_clean":"2024-09-16T17:02:13.904130+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:02:13.904130+0000","last_undegraded":"2024-09-16T17:02:13.904130+0000","last_fullsized":"2024-09-16T17:02:13.904130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553624,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1089,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'1063","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.839328+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:02:13.839328+0000","last_peered":"2024-09-16T17:02:13.839328+0000","last_clean":"2024-09-16T17:02:13.839328+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:02:13.839328+0000","last_undegraded":"2024-09-16T17:02:13.839328+0000","last_fullsized":"2024-09-16T17:02:13.839328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1021","reported_seq":1060,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.869660+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:02:13.869660+0000","last_peered":"2024-09-16T17:02:13.869660+0000","last_clean":"2024-09-16T17:02:13.869660+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:02:13.869660+0000","last_undegraded":"2024-09-16T17:02:13.869660+0000","last_fullsized":"2024-09-16T17:02:13.869660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1065","reported_seq":1103,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867599+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:02:13.867599+0000","last_peered":"2024-09-16T17:02:13.867599+0000","last_clean":"2024-09-16T17:02:13.867599+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:02:13.867599+0000","last_undegraded":"2024-09-16T17:02:13.867599+0000","last_fullsized":"2024-09-16T17:02:13.867599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'1091","reported_seq":1130,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.927287+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:02:13.927287+0000","last_peered":"2024-09-16T17:02:13.927287+0000","last_clean":"2024-09-16T17:02:13.927287+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:02:13.927287+0000","last_undegraded":"2024-09-16T17:02:13.927287+0000","last_fullsized":"2024-09-16T17:02:13.927287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1029","reported_seq":1065,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.715866+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:02:13.715866+0000","last_peered":"2024-09-16T17:02:13.715866+0000","last_clean":"2024-09-16T17:02:13.715866+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:02:13.715866+0000","last_undegraded":"2024-09-16T17:02:13.715866+0000","last_fullsized":"2024-09-16T17:02:13.715866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1068","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.866498+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:02:13.866498+0000","last_peered":"2024-09-16T17:02:13.866498+0000","last_clean":"2024-09-16T17:02:13.866498+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:02:13.866498+0000","last_undegraded":"2024-09-16T17:02:13.866498+0000","last_fullsized":"2024-09-16T17:02:13.866498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.864119+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:13.864119+0000","last_peered":"2024-09-16T17:02:13.864119+0000","last_clean":"2024-09-16T17:02:13.864119+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:13.864119+0000","last_undegraded":"2024-09-16T17:02:13.864119+0000","last_fullsized":"2024-09-16T17:02:13.864119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.868194+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:01:55.868194+0000","last_peered":"2024-09-16T17:01:55.868194+0000","last_clean":"2024-09-16T17:01:55.868194+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:01:55.868194+0000","last_undegraded":"2024-09-16T17:01:55.868194+0000","last_fullsized":"2024-09-16T17:01:55.868194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1039","reported_seq":1075,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.491090+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:02:13.491090+0000","last_peered":"2024-09-16T17:02:13.491090+0000","last_clean":"2024-09-16T17:02:13.491090+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:02:13.491090+0000","last_undegraded":"2024-09-16T17:02:13.491090+0000","last_fullsized":"2024-09-16T17:02:13.491090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.698876+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:00.698876+0000","last_peered":"2024-09-16T17:02:00.698876+0000","last_clean":"2024-09-16T17:02:00.698876+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:00.698876+0000","last_undegraded":"2024-09-16T17:02:00.698876+0000","last_fullsized":"2024-09-16T17:02:00.698876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1081","reported_seq":1120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.837844+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:02:13.837844+0000","last_peered":"2024-09-16T17:02:13.837844+0000","last_clean":"2024-09-16T17:02:13.837844+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:02:13.837844+0000","last_undegraded":"2024-09-16T17:02:13.837844+0000","last_fullsized":"2024-09-16T17:02:13.837844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1081,"log_dups_size":0,"ondisk_log_size":1081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.857599+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:01:55.857599+0000","last_peered":"2024-09-16T17:01:55.857599+0000","last_clean":"2024-09-16T17:01:55.857599+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:01:55.857599+0000","last_undegraded":"2024-09-16T17:01:55.857599+0000","last_fullsized":"2024-09-16T17:01:55.857599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1084","reported_seq":1120,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.747534+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:02:13.747534+0000","last_peered":"2024-09-16T17:02:13.747534+0000","last_clean":"2024-09-16T17:02:13.747534+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:02:13.747534+0000","last_undegraded":"2024-09-16T17:02:13.747534+0000","last_fullsized":"2024-09-16T17:02:13.747534+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.697611+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:00.697611+0000","last_peered":"2024-09-16T17:02:00.697611+0000","last_clean":"2024-09-16T17:02:00.697611+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:00.697611+0000","last_undegraded":"2024-09-16T17:02:00.697611+0000","last_fullsized":"2024-09-16T17:02:00.697611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1030","reported_seq":1066,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.417399+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:02:13.417399+0000","last_peered":"2024-09-16T17:02:13.417399+0000","last_clean":"2024-09-16T17:02:13.417399+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:02:13.417399+0000","last_undegraded":"2024-09-16T17:02:13.417399+0000","last_fullsized":"2024-09-16T17:02:13.417399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.841633+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:13.841633+0000","last_peered":"2024-09-16T17:02:13.841633+0000","last_clean":"2024-09-16T17:02:13.841633+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:13.841633+0000","last_undegraded":"2024-09-16T17:02:13.841633+0000","last_fullsized":"2024-09-16T17:02:13.841633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'1151","reported_seq":1190,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.832719+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:02:13.832719+0000","last_peered":"2024-09-16T17:02:13.832719+0000","last_clean":"2024-09-16T17:02:13.832719+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:02:13.832719+0000","last_undegraded":"2024-09-16T17:02:13.832719+0000","last_fullsized":"2024-09-16T17:02:13.832719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868838+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:13.868838+0000","last_peered":"2024-09-16T17:02:13.868838+0000","last_clean":"2024-09-16T17:02:13.868838+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:13.868838+0000","last_undegraded":"2024-09-16T17:02:13.868838+0000","last_fullsized":"2024-09-16T17:02:13.868838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1030","reported_seq":1069,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867330+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:02:13.867330+0000","last_peered":"2024-09-16T17:02:13.867330+0000","last_clean":"2024-09-16T17:02:13.867330+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:02:13.867330+0000","last_undegraded":"2024-09-16T17:02:13.867330+0000","last_fullsized":"2024-09-16T17:02:13.867330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.840482+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:13.840482+0000","last_peered":"2024-09-16T17:02:13.840482+0000","last_clean":"2024-09-16T17:02:13.840482+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:13.840482+0000","last_undegraded":"2024-09-16T17:02:13.840482+0000","last_fullsized":"2024-09-16T17:02:13.840482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1080","reported_seq":1119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868947+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:02:13.868947+0000","last_peered":"2024-09-16T17:02:13.868947+0000","last_clean":"2024-09-16T17:02:13.868947+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:02:13.868947+0000","last_undegraded":"2024-09-16T17:02:13.868947+0000","last_fullsized":"2024-09-16T17:02:13.868947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.871106+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:01:55.871106+0000","last_peered":"2024-09-16T17:01:55.871106+0000","last_clean":"2024-09-16T17:01:55.871106+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:01:55.871106+0000","last_undegraded":"2024-09-16T17:01:55.871106+0000","last_fullsized":"2024-09-16T17:01:55.871106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":115277848,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17084,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213475450880,"internally_reserved":0,"allocated":736043008,"data_stored":736043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213474922496,"internally_reserved":0,"allocated":736571392,"data_stored":736571392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229116,"kb_used_data":229116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068612,"statfs":{"total":53552873472,"available":53318258688,"internally_reserved":0,"allocated":234614784,"data_stored":234614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":133716,"kb_used_data":133716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52164012,"statfs":{"total":53552873472,"available":53415948288,"internally_reserved":0,"allocated":136925184,"data_stored":136925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197548,"kb_used_data":197548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52100180,"statfs":{"total":53552873472,"available":53350584320,"internally_reserved":0,"allocated":202289152,"data_stored":202289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":170848,"kb_used_data":170848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52126880,"statfs":{"total":53552873472,"available":53377925120,"internally_reserved":0,"allocated":174948352,"data_stored":174948352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53383110656,"internally_reserved":0,"allocated":169762816,"data_stored":169762816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53351129088,"internally_reserved":0,"allocated":201744384,"data_stored":201744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420953600,"internally_reserved":0,"allocated":131919872,"data_stored":131919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53383241728,"internally_reserved":0,"allocated":169631744,"data_stored":169631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53351264256,"internally_reserved":0,"allocated":201609216,"data_stored":201609216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53421084672,"internally_reserved":0,"allocated":131788800,"data_stored":131788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53319860224,"internally_reserved":0,"allocated":233013248,"data_stored":233013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:28.705 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:02:28.705 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:02:28.705 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:28.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:28.832+0000 7f9518391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:28.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:28.840+0000 7f9518391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:29.098 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:29.098 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:29.115 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2024-09-16T17:02:27.955792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115868235,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17165,"num_write_kb":604053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17139,"ondisk_log_size":17139,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":731228,"kb_used_data":731228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208459684,"statfs":{"total":214211493888,"available":213462716416,"internally_reserved":0,"allocated":748777472,"data_stored":748777472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000879"},"pg_stats":[{"pgid":"7.f","version":"96'1113","reported_seq":1152,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.861184+0000","last_change":"2024-09-16T16:59:31.188237+0000","last_active":"2024-09-16T17:02:13.861184+0000","last_peered":"2024-09-16T17:02:13.861184+0000","last_clean":"2024-09-16T17:02:13.861184+0000","last_became_active":"2024-09-16T16:59:31.134002+0000","last_became_peered":"2024-09-16T16:59:31.134002+0000","last_unstale":"2024-09-16T17:02:13.861184+0000","last_undegraded":"2024-09-16T17:02:13.861184+0000","last_fullsized":"2024-09-16T17:02:13.861184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1050","reported_seq":1086,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.546708+0000","last_change":"2024-09-16T16:59:31.212150+0000","last_active":"2024-09-16T17:02:13.546708+0000","last_peered":"2024-09-16T17:02:13.546708+0000","last_clean":"2024-09-16T17:02:13.546708+0000","last_became_active":"2024-09-16T16:59:31.197875+0000","last_became_peered":"2024-09-16T16:59:31.197875+0000","last_unstale":"2024-09-16T17:02:13.546708+0000","last_undegraded":"2024-09-16T17:02:13.546708+0000","last_fullsized":"2024-09-16T17:02:13.546708+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":36288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"97'1089","reported_seq":1129,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.904130+0000","last_change":"2024-09-16T16:59:31.171621+0000","last_active":"2024-09-16T17:02:13.904130+0000","last_peered":"2024-09-16T17:02:13.904130+0000","last_clean":"2024-09-16T17:02:13.904130+0000","last_became_active":"2024-09-16T16:59:31.155975+0000","last_became_peered":"2024-09-16T16:59:31.155975+0000","last_unstale":"2024-09-16T17:02:13.904130+0000","last_undegraded":"2024-09-16T17:02:13.904130+0000","last_fullsized":"2024-09-16T17:02:13.904130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553624,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1089,"num_write_kb":38017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"97'1063","reported_seq":1102,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.839328+0000","last_change":"2024-09-16T16:59:31.154854+0000","last_active":"2024-09-16T17:02:13.839328+0000","last_peered":"2024-09-16T17:02:13.839328+0000","last_clean":"2024-09-16T17:02:13.839328+0000","last_became_active":"2024-09-16T16:59:31.148318+0000","last_became_peered":"2024-09-16T16:59:31.148318+0000","last_unstale":"2024-09-16T17:02:13.839328+0000","last_undegraded":"2024-09-16T17:02:13.839328+0000","last_fullsized":"2024-09-16T17:02:13.839328+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1021","reported_seq":1060,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.869660+0000","last_change":"2024-09-16T16:59:31.224228+0000","last_active":"2024-09-16T17:02:13.869660+0000","last_peered":"2024-09-16T17:02:13.869660+0000","last_clean":"2024-09-16T17:02:13.869660+0000","last_became_active":"2024-09-16T16:59:31.202607+0000","last_became_peered":"2024-09-16T16:59:31.202607+0000","last_unstale":"2024-09-16T17:02:13.869660+0000","last_undegraded":"2024-09-16T17:02:13.869660+0000","last_fullsized":"2024-09-16T17:02:13.869660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":36736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1065","reported_seq":1103,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867599+0000","last_change":"2024-09-16T16:59:31.189809+0000","last_active":"2024-09-16T17:02:13.867599+0000","last_peered":"2024-09-16T17:02:13.867599+0000","last_clean":"2024-09-16T17:02:13.867599+0000","last_became_active":"2024-09-16T16:59:31.157499+0000","last_became_peered":"2024-09-16T16:59:31.157499+0000","last_unstale":"2024-09-16T17:02:13.867599+0000","last_undegraded":"2024-09-16T17:02:13.867599+0000","last_fullsized":"2024-09-16T17:02:13.867599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1065,"num_write_kb":37568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"97'1091","reported_seq":1130,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.927287+0000","last_change":"2024-09-16T16:59:31.260563+0000","last_active":"2024-09-16T17:02:13.927287+0000","last_peered":"2024-09-16T17:02:13.927287+0000","last_clean":"2024-09-16T17:02:13.927287+0000","last_became_active":"2024-09-16T16:59:31.254090+0000","last_became_peered":"2024-09-16T16:59:31.254090+0000","last_unstale":"2024-09-16T17:02:13.927287+0000","last_undegraded":"2024-09-16T17:02:13.927287+0000","last_fullsized":"2024-09-16T17:02:13.927287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1029","reported_seq":1065,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.715866+0000","last_change":"2024-09-16T16:59:31.160497+0000","last_active":"2024-09-16T17:02:13.715866+0000","last_peered":"2024-09-16T17:02:13.715866+0000","last_clean":"2024-09-16T17:02:13.715866+0000","last_became_active":"2024-09-16T16:59:31.143259+0000","last_became_peered":"2024-09-16T16:59:31.143259+0000","last_unstale":"2024-09-16T17:02:13.715866+0000","last_undegraded":"2024-09-16T17:02:13.715866+0000","last_fullsized":"2024-09-16T17:02:13.715866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1029,"log_dups_size":0,"ondisk_log_size":1029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1068","reported_seq":1107,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.866498+0000","last_change":"2024-09-16T16:59:31.158124+0000","last_active":"2024-09-16T17:02:13.866498+0000","last_peered":"2024-09-16T17:02:13.866498+0000","last_clean":"2024-09-16T17:02:13.866498+0000","last_became_active":"2024-09-16T16:59:31.145710+0000","last_became_peered":"2024-09-16T16:59:31.145710+0000","last_unstale":"2024-09-16T17:02:13.866498+0000","last_undegraded":"2024-09-16T17:02:13.866498+0000","last_fullsized":"2024-09-16T17:02:13.866498+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":331,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.864119+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:13.864119+0000","last_peered":"2024-09-16T17:02:13.864119+0000","last_clean":"2024-09-16T17:02:13.864119+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:13.864119+0000","last_undegraded":"2024-09-16T17:02:13.864119+0000","last_fullsized":"2024-09-16T17:02:13.864119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":257,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.868194+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:01:55.868194+0000","last_peered":"2024-09-16T17:01:55.868194+0000","last_clean":"2024-09-16T17:01:55.868194+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:01:55.868194+0000","last_undegraded":"2024-09-16T17:01:55.868194+0000","last_fullsized":"2024-09-16T17:01:55.868194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1039","reported_seq":1075,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.491090+0000","last_change":"2024-09-16T16:59:31.132439+0000","last_active":"2024-09-16T17:02:13.491090+0000","last_peered":"2024-09-16T17:02:13.491090+0000","last_clean":"2024-09-16T17:02:13.491090+0000","last_became_active":"2024-09-16T16:59:31.118574+0000","last_became_peered":"2024-09-16T16:59:31.118574+0000","last_unstale":"2024-09-16T17:02:13.491090+0000","last_undegraded":"2024-09-16T17:02:13.491090+0000","last_fullsized":"2024-09-16T17:02:13.491090+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":36608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.698876+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:00.698876+0000","last_peered":"2024-09-16T17:02:00.698876+0000","last_clean":"2024-09-16T17:02:00.698876+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:00.698876+0000","last_undegraded":"2024-09-16T17:02:00.698876+0000","last_fullsized":"2024-09-16T17:02:00.698876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1081","reported_seq":1120,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.837844+0000","last_change":"2024-09-16T16:59:31.209182+0000","last_active":"2024-09-16T17:02:13.837844+0000","last_peered":"2024-09-16T17:02:13.837844+0000","last_clean":"2024-09-16T17:02:13.837844+0000","last_became_active":"2024-09-16T16:59:31.200297+0000","last_became_peered":"2024-09-16T16:59:31.200297+0000","last_unstale":"2024-09-16T17:02:13.837844+0000","last_undegraded":"2024-09-16T17:02:13.837844+0000","last_fullsized":"2024-09-16T17:02:13.837844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1081,"log_dups_size":0,"ondisk_log_size":1081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":37824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.857599+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:01:55.857599+0000","last_peered":"2024-09-16T17:01:55.857599+0000","last_clean":"2024-09-16T17:01:55.857599+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:01:55.857599+0000","last_undegraded":"2024-09-16T17:01:55.857599+0000","last_fullsized":"2024-09-16T17:01:55.857599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1084","reported_seq":1120,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.747534+0000","last_change":"2024-09-16T16:59:31.270696+0000","last_active":"2024-09-16T17:02:13.747534+0000","last_peered":"2024-09-16T17:02:13.747534+0000","last_clean":"2024-09-16T17:02:13.747534+0000","last_became_active":"2024-09-16T16:59:31.264844+0000","last_became_peered":"2024-09-16T16:59:31.264844+0000","last_unstale":"2024-09-16T17:02:13.747534+0000","last_undegraded":"2024-09-16T17:02:13.747534+0000","last_fullsized":"2024-09-16T17:02:13.747534+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1084,"log_dups_size":0,"ondisk_log_size":1084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":258,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:00.697611+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:00.697611+0000","last_peered":"2024-09-16T17:02:00.697611+0000","last_clean":"2024-09-16T17:02:00.697611+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:00.697611+0000","last_undegraded":"2024-09-16T17:02:00.697611+0000","last_fullsized":"2024-09-16T17:02:00.697611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1030","reported_seq":1066,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.417399+0000","last_change":"2024-09-16T16:59:31.238596+0000","last_active":"2024-09-16T17:02:13.417399+0000","last_peered":"2024-09-16T17:02:13.417399+0000","last_clean":"2024-09-16T17:02:13.417399+0000","last_became_active":"2024-09-16T16:59:31.226394+0000","last_became_peered":"2024-09-16T16:59:31.226394+0000","last_unstale":"2024-09-16T17:02:13.417399+0000","last_undegraded":"2024-09-16T17:02:13.417399+0000","last_fullsized":"2024-09-16T17:02:13.417399+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.841633+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:13.841633+0000","last_peered":"2024-09-16T17:02:13.841633+0000","last_clean":"2024-09-16T17:02:13.841633+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:13.841633+0000","last_undegraded":"2024-09-16T17:02:13.841633+0000","last_fullsized":"2024-09-16T17:02:13.841633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"97'1151","reported_seq":1190,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.832719+0000","last_change":"2024-09-16T16:59:31.300047+0000","last_active":"2024-09-16T17:02:13.832719+0000","last_peered":"2024-09-16T17:02:13.832719+0000","last_clean":"2024-09-16T17:02:13.832719+0000","last_became_active":"2024-09-16T16:59:31.293452+0000","last_became_peered":"2024-09-16T16:59:31.293452+0000","last_unstale":"2024-09-16T17:02:13.832719+0000","last_undegraded":"2024-09-16T17:02:13.832719+0000","last_fullsized":"2024-09-16T17:02:13.832719+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868838+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:13.868838+0000","last_peered":"2024-09-16T17:02:13.868838+0000","last_clean":"2024-09-16T17:02:13.868838+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:13.868838+0000","last_undegraded":"2024-09-16T17:02:13.868838+0000","last_fullsized":"2024-09-16T17:02:13.868838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1030","reported_seq":1069,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.867330+0000","last_change":"2024-09-16T16:59:31.166419+0000","last_active":"2024-09-16T17:02:13.867330+0000","last_peered":"2024-09-16T17:02:13.867330+0000","last_clean":"2024-09-16T17:02:13.867330+0000","last_became_active":"2024-09-16T16:59:31.153384+0000","last_became_peered":"2024-09-16T16:59:31.153384+0000","last_unstale":"2024-09-16T17:02:13.867330+0000","last_undegraded":"2024-09-16T17:02:13.867330+0000","last_fullsized":"2024-09-16T17:02:13.867330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.840482+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:13.840482+0000","last_peered":"2024-09-16T17:02:13.840482+0000","last_clean":"2024-09-16T17:02:13.840482+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:13.840482+0000","last_undegraded":"2024-09-16T17:02:13.840482+0000","last_fullsized":"2024-09-16T17:02:13.840482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1080","reported_seq":1119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-16T17:02:13.868947+0000","last_change":"2024-09-16T16:59:31.261183+0000","last_active":"2024-09-16T17:02:13.868947+0000","last_peered":"2024-09-16T17:02:13.868947+0000","last_clean":"2024-09-16T17:02:13.868947+0000","last_became_active":"2024-09-16T16:59:31.253275+0000","last_became_peered":"2024-09-16T16:59:31.253275+0000","last_unstale":"2024-09-16T17:02:13.868947+0000","last_undegraded":"2024-09-16T17:02:13.868947+0000","last_fullsized":"2024-09-16T17:02:13.868947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:29.979438+0000","last_clean_scrub_stamp":"2024-09-16T16:59:29.979438+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.871106+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:01:55.871106+0000","last_peered":"2024-09-16T17:01:55.871106+0000","last_clean":"2024-09-16T17:01:55.871106+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:01:55.871106+0000","last_undegraded":"2024-09-16T17:01:55.871106+0000","last_fullsized":"2024-09-16T17:01:55.871106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":115277848,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17084,"num_write_kb":602945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213475450880,"internally_reserved":0,"allocated":736043008,"data_stored":736043008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17084,"ondisk_log_size":17084,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213474922496,"internally_reserved":0,"allocated":736571392,"data_stored":736571392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":229116,"kb_used_data":229116,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52068612,"statfs":{"total":53552873472,"available":53318258688,"internally_reserved":0,"allocated":234614784,"data_stored":234614784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":133716,"kb_used_data":133716,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52164012,"statfs":{"total":53552873472,"available":53415948288,"internally_reserved":0,"allocated":136925184,"data_stored":136925184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":197548,"kb_used_data":197548,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52100180,"statfs":{"total":53552873472,"available":53350584320,"internally_reserved":0,"allocated":202289152,"data_stored":202289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":170848,"kb_used_data":170848,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52126880,"statfs":{"total":53552873472,"available":53377925120,"internally_reserved":0,"allocated":174948352,"data_stored":174948352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53383110656,"internally_reserved":0,"allocated":169762816,"data_stored":169762816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53351129088,"internally_reserved":0,"allocated":201744384,"data_stored":201744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53420953600,"internally_reserved":0,"allocated":131919872,"data_stored":131919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53319729152,"internally_reserved":0,"allocated":233144320,"data_stored":233144320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53383241728,"internally_reserved":0,"allocated":169631744,"data_stored":169631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53351264256,"internally_reserved":0,"allocated":201609216,"data_stored":201609216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53421084672,"internally_reserved":0,"allocated":131788800,"data_stored":131788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53319860224,"internally_reserved":0,"allocated":233013248,"data_stored":233013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:29.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:29.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:29.788+0000 7f747d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:29.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:29.793+0000 7f747d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:29.942 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Removed 9421 objects 2024-09-16T17:02:29.942 INFO:tasks.radosbench.radosbench.0.smithi103.stdout:Clean up completed and total clean up time :86.8116 2024-09-16T17:02:31.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:02:32.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:32.079+0000 7f31d10bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:32.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:32.085+0000 7f31d10bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.117 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:02:34.118 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:02:34.118 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:02:34.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:02:34.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:02:34.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.237+0000 7f65154fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.245+0000 7f65154fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:34.267 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:34.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:34.270 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:34.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:02:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.305+0000 7f2ae6751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.310+0000 7f2ae6751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.383+0000 7fbcca863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.392+0000 7fbcca863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:34.410 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:34.411 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:34.413 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:34.414 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:34.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:02:34.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.562+0000 7f42582bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.570+0000 7f42582bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:34.589 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:34.590 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:34.592 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:34.592 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:34.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:02:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.695+0000 7f15f009c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:34.703+0000 7f15f009c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:no valid command found; 10 closest matches: 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:bench [] [] [] [] 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:config get 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:config help 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:config set ... 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:config show 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:deep_scrub 2024-09-16T17:02:34.722 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_ops 2024-09-16T17:02:34.723 INFO:teuthology.orchestra.run.smithi103.stderr:dump_historic_slow_ops 2024-09-16T17:02:34.723 INFO:teuthology.orchestra.run.smithi103.stderr:dump_metrics [] 2024-09-16T17:02:34.723 INFO:teuthology.orchestra.run.smithi103.stderr:dump_ops_in_flight 2024-09-16T17:02:34.723 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINVAL: invalid command 2024-09-16T17:02:34.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:02:34.726 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:02:35.057 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-16T17:02:35.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-16T17:02:35.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:35.167+0000 7fc097cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:35.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:35.181+0000 7fc097cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:36.018 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'unique_pool_4' removed 2024-09-16T17:02:36.036 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-16T17:02:36.046 INFO:tasks.thrashosds:joining thrashosds 2024-09-16T17:02:39.726 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-16T17:02:39.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:39.840+0000 7fcbfeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:39.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:39.845+0000 7fcbfeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:39.860 INFO:teuthology.orchestra.run.smithi103.stdout:{} 2024-09-16T17:02:39.860 INFO:teuthology.orchestra.run.smithi103.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T17:02:39.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:02:39.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:39.974+0000 7fe130791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:39.984+0000 7fe130791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:02:41.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-16T17:02:41.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:41.170+0000 7fe6d6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:41.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:41.180+0000 7fe6d6191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:42.034 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-16T17:02:42.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:02:42.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:42.164+0000 7f50b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:42.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:42.174+0000 7f50b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:43.038 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:02:43.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-16T17:02:43.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:43.167+0000 7f3a4fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:43.177+0000 7f3a4fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:44.043 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-16T17:02:44.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:02:44.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:44.171+0000 7f376109c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:44.181+0000 7f376109c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:45.047 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:02:45.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-16T17:02:45.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:45.176+0000 7fc2ac791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:45.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:45.186+0000 7fc2ac791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:46.052 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-16T17:02:46.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:02:46.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:46.177+0000 7f6a61711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:46.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:46.187+0000 7f6a61711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:47.057 INFO:teuthology.orchestra.run.smithi103.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:02:47.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-16T17:02:47.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:47.186+0000 7f8d2d311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:47.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:47.196+0000 7f8d2d311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.061 INFO:teuthology.orchestra.run.smithi103.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-16T17:02:48.083 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-16T17:02:48.084 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T17:02:48.084 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:02:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.194+0000 7f96b9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.202+0000 7f96b9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:48.386 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T17:02:48.060698+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.898738+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:02:48.400 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T17:02:48.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:02:48.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.503+0000 7f6f8c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.511+0000 7f6f8c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.698 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:48.698 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T17:02:48.060698+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.898738+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:02:48.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T17:02:48.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T17:02:48.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T17:02:48.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T17:02:48.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.825+0000 7f99bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.826+0000 7f9020f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.826+0000 7fb6ae551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.826+0000 7fd531591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.835+0000 7fd531591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.835+0000 7f99bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.836+0000 7f9020f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.836+0000 7fb6ae551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.869 INFO:teuthology.orchestra.run.smithi103.stdout:38654706628 2024-09-16T17:02:48.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T17:02:48.872 INFO:teuthology.orchestra.run.smithi103.stdout:38654706629 2024-09-16T17:02:48.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T17:02:48.873 INFO:teuthology.orchestra.run.smithi103.stdout:42949673924 2024-09-16T17:02:48.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T17:02:48.875 INFO:teuthology.orchestra.run.smithi103.stdout:42949673923 2024-09-16T17:02:48.876 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T17:02:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.976+0000 7faa0389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:48.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:48.987+0000 7faa0389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.027+0000 7f78b0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.029+0000 7feb07abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.037+0000 7f78b0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.040+0000 7feb07abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.074+0000 7f60738fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:49.086+0000 7f60738fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:49.233 INFO:teuthology.orchestra.run.smithi103.stdout:38654706623 2024-09-16T17:02:49.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706628 got 38654706623 for osd.0 2024-09-16T17:02:49.267 INFO:teuthology.orchestra.run.smithi103.stdout:38654706624 2024-09-16T17:02:49.275 INFO:teuthology.orchestra.run.smithi103.stdout:42949673919 2024-09-16T17:02:49.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706629 got 38654706624 for osd.1 2024-09-16T17:02:49.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673924 got 42949673919 for osd.3 2024-09-16T17:02:49.314 INFO:teuthology.orchestra.run.smithi103.stdout:42949673918 2024-09-16T17:02:49.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673923 got 42949673918 for osd.2 2024-09-16T17:02:50.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T17:02:50.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T17:02:50.290 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T17:02:50.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T17:02:50.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.361+0000 7f408b2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.374+0000 7f408b2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.403+0000 7f2aeb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.403+0000 7f7cf10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.413+0000 7f2aeb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.413+0000 7f7cf10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.473+0000 7f9fd7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.482+0000 7f9fd7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.611 INFO:teuthology.orchestra.run.smithi103.stdout:38654706628 2024-09-16T17:02:50.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706628 got 38654706628 for osd.0 2024-09-16T17:02:50.625 DEBUG:teuthology.parallel:result is None 2024-09-16T17:02:50.655 INFO:teuthology.orchestra.run.smithi103.stdout:38654706629 2024-09-16T17:02:50.659 INFO:teuthology.orchestra.run.smithi103.stdout:42949673924 2024-09-16T17:02:50.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706629 got 38654706629 for osd.1 2024-09-16T17:02:50.670 DEBUG:teuthology.parallel:result is None 2024-09-16T17:02:50.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673924 got 42949673924 for osd.3 2024-09-16T17:02:50.673 DEBUG:teuthology.parallel:result is None 2024-09-16T17:02:50.679 INFO:teuthology.orchestra.run.smithi103.stdout:42949673923 2024-09-16T17:02:50.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673923 got 42949673923 for osd.2 2024-09-16T17:02:50.693 DEBUG:teuthology.parallel:result is None 2024-09-16T17:02:50.693 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:02:50.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.837+0000 7f5a1db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:50.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:50.845+0000 7f5a1db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.028 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:51.041 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-16T17:02:49.961084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912868"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:51.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:51.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.145+0000 7fc71db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.153+0000 7fc71db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:51.349 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-16T17:02:49.961084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.912868"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:51.350 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:02:51.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-16T17:02:51.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.453+0000 7fb3da89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.463+0000 7fb3da89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.666 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T17:02:51.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T17:02:51.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:51.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.777+0000 7f6723991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:51.785+0000 7f6723991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:51.970 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:51.984 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-16T17:02:51.961563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001509"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:51.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.088+0000 7fb888951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.096+0000 7fb888951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.279 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:52.279 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:52.292 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-16T17:02:51.961563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001509"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:52.292 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T17:02:52.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:52.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.397+0000 7fedd1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.405+0000 7fedd1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.589 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:52.589 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:52.602 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-16T17:02:51.961563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001509"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:52.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:02:52.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.705+0000 7f1745911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:52.713+0000 7f1745911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:52.899 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:52.899 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":113,"fsid":"f25e6613-aa37-429e-93f8-21da834447fa","created":"2024-09-16T16:46:36.654084+0000","modified":"2024-09-16T17:02:48.060698+0000","last_up_change":"2024-09-16T16:46:43.807309+0000","last_in_change":"2024-09-16T16:46:38.771010+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:45.786370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:46.898738+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"addd4808-261e-4463-a41d-bd62072193ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":254186612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6801","nonce":254186612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6807","nonce":254186612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":254186612}]},"public_addr":"172.21.15.103:6800/254186612","cluster_addr":"172.21.15.103:6801/254186612","heartbeat_back_addr":"172.21.15.103:6807/254186612","heartbeat_front_addr":"172.21.15.103:6808/254186612","state":["exists","up"]},{"osd":1,"uuid":"2eeccfe6-e6d7-4e8b-8f33-e5c36deea048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6803","nonce":589375751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":589375751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":589375751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6805","nonce":589375751}]},"public_addr":"172.21.15.103:6803/589375751","cluster_addr":"172.21.15.103:6802/589375751","heartbeat_back_addr":"172.21.15.103:6806/589375751","heartbeat_front_addr":"172.21.15.103:6805/589375751","state":["exists","up"]},{"osd":2,"uuid":"6ad824d5-21d6-45c5-bef3-5b19fd38ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2370785701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6803","nonce":2370785701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":2370785701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2370785701}]},"public_addr":"172.21.15.142:6804/2370785701","cluster_addr":"172.21.15.142:6803/2370785701","heartbeat_back_addr":"172.21.15.142:6809/2370785701","heartbeat_front_addr":"172.21.15.142:6810/2370785701","state":["exists","up"]},{"osd":3,"uuid":"2d88a9d1-ef59-41fe-a72b-0c2abe5ae620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":800639534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":800639534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6807","nonce":800639534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":800639534}]},"public_addr":"172.21.15.142:6805/800639534","cluster_addr":"172.21.15.142:6806/800639534","heartbeat_back_addr":"172.21.15.142:6807/800639534","heartbeat_front_addr":"172.21.15.142:6808/800639534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:02:53.913 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T17:02:53.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:02:54.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.025+0000 7f736bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.037+0000 7f736bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.053 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-16T17:02:54.054 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-16T17:02:54.054 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-16T17:02:54.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T17:02:54.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.168+0000 7f48d0151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.177+0000 7f48d0151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.366 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T17:02:54.387 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T17:02:54.388 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:02:54.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.491+0000 7fefefc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.504+0000 7fefefc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.518 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-16T17:02:54.519 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-16T17:02:54.519 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-16T17:02:54.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T17:02:54.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.633+0000 7f45dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.642+0000 7f45dcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.828 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T17:02:54.851 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T17:02:54.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:02:54.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.956+0000 7f0c63cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:54.968+0000 7f0c63cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:54.987 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-16T17:02:54.987 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-16T17:02:54.987 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-16T17:02:54.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T17:02:55.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.101+0000 7ff40b748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.110+0000 7ff40b748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T17:02:55.309 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T17:02:55.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:02:55.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.412+0000 7fd6f5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.425+0000 7fd6f5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.442 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-16T17:02:55.442 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "" 2024-09-16T17:02:55.442 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-16T17:02:55.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T17:02:55.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.556+0000 7f8672191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.565+0000 7f8672191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.754 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T17:02:55.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:55.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.871+0000 7f0564b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:55.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:02:55.879+0000 7f0564b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:02:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:02:56.075 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2024-09-16T17:02:55.962540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.904808"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":379,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.083717+0000","last_change":"2024-09-16T16:46:46.894917+0000","last_active":"2024-09-16T17:02:48.083717+0000","last_peered":"2024-09-16T17:02:48.083717+0000","last_clean":"2024-09-16T17:02:48.083717+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:48.083717+0000","last_undegraded":"2024-09-16T17:02:48.083717+0000","last_fullsized":"2024-09-16T17:02:48.083717+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:45.813704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":308,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088281+0000","last_change":"2024-09-16T16:46:50.867412+0000","last_active":"2024-09-16T17:02:48.088281+0000","last_peered":"2024-09-16T17:02:48.088281+0000","last_clean":"2024-09-16T17:02:48.088281+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:48.088281+0000","last_undegraded":"2024-09-16T17:02:48.088281+0000","last_fullsized":"2024-09-16T17:02:48.088281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.088610+0000","last_change":"2024-09-16T16:46:50.866028+0000","last_active":"2024-09-16T17:02:48.088610+0000","last_peered":"2024-09-16T17:02:48.088610+0000","last_clean":"2024-09-16T17:02:48.088610+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:48.088610+0000","last_undegraded":"2024-09-16T17:02:48.088610+0000","last_fullsized":"2024-09-16T17:02:48.088610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.084861+0000","last_change":"2024-09-16T16:46:50.862241+0000","last_active":"2024-09-16T17:02:48.084861+0000","last_peered":"2024-09-16T17:02:48.084861+0000","last_clean":"2024-09-16T17:02:48.084861+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:48.084861+0000","last_undegraded":"2024-09-16T17:02:48.084861+0000","last_fullsized":"2024-09-16T17:02:48.084861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087676+0000","last_change":"2024-09-16T16:46:50.864627+0000","last_active":"2024-09-16T17:02:48.087676+0000","last_peered":"2024-09-16T17:02:48.087676+0000","last_clean":"2024-09-16T17:02:48.087676+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:48.087676+0000","last_undegraded":"2024-09-16T17:02:48.087676+0000","last_fullsized":"2024-09-16T17:02:48.087676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.104330+0000","last_change":"2024-09-16T16:46:50.862813+0000","last_active":"2024-09-16T17:02:48.104330+0000","last_peered":"2024-09-16T17:02:48.104330+0000","last_clean":"2024-09-16T17:02:48.104330+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:48.104330+0000","last_undegraded":"2024-09-16T17:02:48.104330+0000","last_fullsized":"2024-09-16T17:02:48.104330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.086304+0000","last_change":"2024-09-16T16:46:50.862011+0000","last_active":"2024-09-16T17:02:48.086304+0000","last_peered":"2024-09-16T17:02:48.086304+0000","last_clean":"2024-09-16T17:02:48.086304+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:48.086304+0000","last_undegraded":"2024-09-16T17:02:48.086304+0000","last_fullsized":"2024-09-16T17:02:48.086304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.103657+0000","last_change":"2024-09-16T16:46:50.862155+0000","last_active":"2024-09-16T17:02:48.103657+0000","last_peered":"2024-09-16T17:02:48.103657+0000","last_clean":"2024-09-16T17:02:48.103657+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:48.103657+0000","last_undegraded":"2024-09-16T17:02:48.103657+0000","last_fullsized":"2024-09-16T17:02:48.103657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:48.087320+0000","last_change":"2024-09-16T16:46:50.867501+0000","last_active":"2024-09-16T17:02:48.087320+0000","last_peered":"2024-09-16T17:02:48.087320+0000","last_clean":"2024-09-16T17:02:48.087320+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:48.087320+0000","last_undegraded":"2024-09-16T17:02:48.087320+0000","last_fullsized":"2024-09-16T17:02:48.087320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:47.820721+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706629,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706628,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:46:45.813704+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=45, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.079 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.080 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:46:47.820721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=2, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:56.080 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:03:16.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:03:16.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:03:16.199+0000 7f2997f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:16.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:03:16.207+0000 7f2997f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-16T17:03:16.395 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-16T17:03:16.407 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":600,"stamp":"2024-09-16T17:03:15.967304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8248,"kb_used_data":8248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182664,"statfs":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002996"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":381,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:55.755987+0000","last_change":"2024-09-16T17:02:55.802723+0000","last_active":"2024-09-16T17:02:55.755987+0000","last_peered":"2024-09-16T17:02:55.755987+0000","last_clean":"2024-09-16T17:02:55.755987+0000","last_became_active":"2024-09-16T16:46:46.874257+0000","last_became_peered":"2024-09-16T16:46:46.874257+0000","last_unstale":"2024-09-16T17:02:55.755987+0000","last_undegraded":"2024-09-16T17:02:55.755987+0000","last_fullsized":"2024-09-16T17:02:55.755987+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2024-09-16T17:02:55.802453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:55.802453+0000","last_clean_scrub_stamp":"2024-09-16T16:46:45.813704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":310,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:54.832895+0000","last_change":"2024-09-16T17:02:54.862081+0000","last_active":"2024-09-16T17:02:54.832895+0000","last_peered":"2024-09-16T17:02:54.832895+0000","last_clean":"2024-09-16T17:02:54.832895+0000","last_became_active":"2024-09-16T16:46:48.933111+0000","last_became_peered":"2024-09-16T16:46:48.933111+0000","last_unstale":"2024-09-16T17:02:54.832895+0000","last_undegraded":"2024-09-16T17:02:54.832895+0000","last_fullsized":"2024-09-16T17:02:54.832895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-09-16T17:02:54.861864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:54.861864+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:54.368384+0000","last_change":"2024-09-16T17:02:54.382971+0000","last_active":"2024-09-16T17:02:54.368384+0000","last_peered":"2024-09-16T17:02:54.368384+0000","last_clean":"2024-09-16T17:02:54.368384+0000","last_became_active":"2024-09-16T16:46:48.951433+0000","last_became_peered":"2024-09-16T16:46:48.951433+0000","last_unstale":"2024-09-16T17:02:54.368384+0000","last_undegraded":"2024-09-16T17:02:54.368384+0000","last_fullsized":"2024-09-16T17:02:54.368384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:54.382797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:54.382797+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:54.831749+0000","last_change":"2024-09-16T17:02:54.849177+0000","last_active":"2024-09-16T17:02:54.831749+0000","last_peered":"2024-09-16T17:02:54.831749+0000","last_clean":"2024-09-16T17:02:54.831749+0000","last_became_active":"2024-09-16T16:46:48.913903+0000","last_became_peered":"2024-09-16T16:46:48.913903+0000","last_unstale":"2024-09-16T17:02:54.831749+0000","last_undegraded":"2024-09-16T17:02:54.831749+0000","last_fullsized":"2024-09-16T17:02:54.831749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:54.848891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:54.848891+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":311,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:54.368636+0000","last_change":"2024-09-16T17:02:54.394349+0000","last_active":"2024-09-16T17:02:54.368636+0000","last_peered":"2024-09-16T17:02:54.368636+0000","last_clean":"2024-09-16T17:02:54.368636+0000","last_became_active":"2024-09-16T16:46:48.931322+0000","last_became_peered":"2024-09-16T16:46:48.931322+0000","last_unstale":"2024-09-16T17:02:54.368636+0000","last_undegraded":"2024-09-16T17:02:54.368636+0000","last_fullsized":"2024-09-16T17:02:54.368636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2024-09-16T17:02:54.394139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:54.394139+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:55.297852+0000","last_change":"2024-09-16T17:02:55.311263+0000","last_active":"2024-09-16T17:02:55.297852+0000","last_peered":"2024-09-16T17:02:55.297852+0000","last_clean":"2024-09-16T17:02:55.297852+0000","last_became_active":"2024-09-16T16:46:48.921873+0000","last_became_peered":"2024-09-16T16:46:48.921873+0000","last_unstale":"2024-09-16T17:02:55.297852+0000","last_undegraded":"2024-09-16T17:02:55.297852+0000","last_fullsized":"2024-09-16T17:02:55.297852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:55.311048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:55.311048+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:55.759025+0000","last_change":"2024-09-16T17:02:55.777059+0000","last_active":"2024-09-16T17:02:55.759025+0000","last_peered":"2024-09-16T17:02:55.759025+0000","last_clean":"2024-09-16T17:02:55.759025+0000","last_became_active":"2024-09-16T16:46:48.929889+0000","last_became_peered":"2024-09-16T16:46:48.929889+0000","last_unstale":"2024-09-16T17:02:55.759025+0000","last_undegraded":"2024-09-16T17:02:55.759025+0000","last_fullsized":"2024-09-16T17:02:55.759025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:55.776704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:55.776704+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:55.297855+0000","last_change":"2024-09-16T17:02:55.312109+0000","last_active":"2024-09-16T17:02:55.297855+0000","last_peered":"2024-09-16T17:02:55.297855+0000","last_clean":"2024-09-16T17:02:55.297855+0000","last_became_active":"2024-09-16T16:46:48.924335+0000","last_became_peered":"2024-09-16T16:46:48.924335+0000","last_unstale":"2024-09-16T17:02:55.297855+0000","last_undegraded":"2024-09-16T17:02:55.297855+0000","last_fullsized":"2024-09-16T17:02:55.297855+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:55.311901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:55.311901+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T17:02:54.834221+0000","last_change":"2024-09-16T17:02:54.853560+0000","last_active":"2024-09-16T17:02:54.834221+0000","last_peered":"2024-09-16T17:02:54.834221+0000","last_clean":"2024-09-16T17:02:54.834221+0000","last_became_active":"2024-09-16T16:46:48.958805+0000","last_became_peered":"2024-09-16T16:46:48.958805+0000","last_unstale":"2024-09-16T17:02:54.834221+0000","last_undegraded":"2024-09-16T17:02:54.834221+0000","last_fullsized":"2024-09-16T17:02:54.834221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:02:54.853364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:02:54.853364+0000","last_clean_scrub_stamp":"2024-09-16T16:46:47.820721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203047936,"internally_reserved":0,"allocated":8445952,"data_stored":8445952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2252,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295476,"statfs":{"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2192,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295536,"statfs":{"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1528,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296200,"statfs":{"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2276,"kb_used_data":2276,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295452,"statfs":{"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550542848,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551308800,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550628864,"internally_reserved":0,"allocated":2244608,"data_stored":2244608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550567424,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:03:16.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T17:03:16.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:03:16.507+0000 7fb1f7551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:16.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-16T17:03:16.519+0000 7fb1f7551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:03:16.728 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T17:03:16.728 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T17:03:16.729 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T17:03:16.729 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:16.805 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T17:03:16.805 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T17:03:16.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:16.895 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T17:03:16.895 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T17:03:16.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:16.977 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T17:03:16.977 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T17:03:16.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:17.049 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T17:03:17.049 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T17:03:17.050 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T17:03:17.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:17.078 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T17:03:17.078 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T17:03:17.078 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T17:03:17.078 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:03:17.091 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T17:03:17.091 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T17:03:17.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-16T17:03:17.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T17:03:17.163 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T17:03:17.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T17:03:17.342 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T17:03:17.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T17:03:17.445 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T17:03:17.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T17:03:17.614 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T17:03:17.703 INFO:tasks.ceph:Archiving mon data... 2024-09-16T17:03:17.704 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/data/mon.a.tgz 2024-09-16T17:03:17.704 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-16T17:03:17.719 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.SutsqsXH0D 2024-09-16T17:03:17.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SutsqsXH0D 2024-09-16T17:03:17.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.SutsqsXH0D 2024-09-16T17:03:17.921 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.SutsqsXH0D is 238KB 2024-09-16T17:03:17.986 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.SutsqsXH0D 2024-09-16T17:03:18.000 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T17:03:18.000 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:03:18.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:03:18.119 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:03:18.136 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:03:18.136 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T17:03:18.138 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi103/crash 2024-09-16T17:03:18.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:03:18.184 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi142/crash 2024-09-16T17:03:18.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:03:18.223 INFO:tasks.ceph:Compressing logs... 2024-09-16T17:03:18.223 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:03:18.229 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:03:18.251 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T17:03:18.251 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68915.log 2024-09-16T17:03:18.301 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27967.log 2024-09-16T17:03:18.301 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27927.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27887.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27967.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27967.log.gz 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27927.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27927.log.gz 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.27887.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27887.log.gz 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27836.log 2024-09-16T17:03:18.302 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.27836.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27836.log.gz 2024-09-16T17:03:18.385 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28382.log 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56794.log 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68915.log.gz 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57284.log 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28382.log.gz 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34436.log 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56794.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56794.log.gz 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65246.log 2024-09-16T17:03:18.398 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57284.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53555.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34436.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63310.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65246.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65246.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61373.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53555.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54475.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63310.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61373.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46499.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54475.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36706.log 2024-09-16T17:03:18.399 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46499.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66843.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52949.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36706.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36706.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49675.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66843.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55221.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52949.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49675.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55221.log.gz 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28842.log 2024-09-16T17:03:18.400 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33260.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47255.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28842.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66206.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33260.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32517.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47255.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52453.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66206.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32517.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50921.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52453.log.gz 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2024-09-16T17:03:18.401 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58689.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50921.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43107.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61687.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58689.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57771.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43107.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67361.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61687.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57771.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31879.log 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67361.log.gz 2024-09-16T17:03:18.402 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45615.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43396.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31879.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51836.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45615.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43396.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51836.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52691.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34017.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52691.log.gz 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39837.log 2024-09-16T17:03:18.403 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34017.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66144.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33000.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39837.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66144.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36000.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33000.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51756.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67403.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36000.log.gz 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-09-16T17:03:18.404 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51756.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56410.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67403.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57123.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56410.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41292.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57123.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57123.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43169.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67445.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41292.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40974.log 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43169.log.gz 2024-09-16T17:03:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.67445.log: /var/log/ceph/ceph-client.admin.37653.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67445.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39978.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40974.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32208.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37653.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37653.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39978.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39978.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30943.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54746.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32208.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30943.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60964.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54746.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65780.log/var/log/ceph/ceph-client.admin.43854.log: 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61233.log 2024-09-16T17:03:18.406 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60964.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65522.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65780.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36766.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61233.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40107.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65522.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36766.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61779.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40107.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43047.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44557.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61779.log.gz 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54564.log 2024-09-16T17:03:18.407 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43047.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45229.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44557.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58500.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54564.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45229.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33429.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58500.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44375.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33429.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38760.log 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2024-09-16T17:03:18.408 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51528.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44375.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43354.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38760.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63934.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51528.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51528.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37243.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43354.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56051.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63934.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59087.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37243.log.gz 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-09-16T17:03:18.409 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56051.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61464.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59087.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57811.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.61464.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63241.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61464.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.57811.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63241.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57647.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54879.log 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-09-16T17:03:18.410 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57647.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29180.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54879.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62283.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29180.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62283.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-09-16T17:03:18.411 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63674.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67989.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57472.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63674.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67989.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57472.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51179.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66052.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64444.log 2024-09-16T17:03:18.412 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29383.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66052.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64444.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38711.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29383.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42499.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.38711.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63052.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63052.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.63052.log.gz 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.32795.log 2024-09-16T17:03:18.413 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.43445.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53907.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51048.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32795.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53907.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51048.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28841.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28841.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68831.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2024-09-16T17:03:18.414 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68831.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46410.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29657.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36526.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46410.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52023.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29657.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32606.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2024-09-16T17:03:18.415 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52023.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67655.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32606.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37065.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64773.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67655.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54355.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37065.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64493.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64773.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56934.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54355.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61821.log 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2024-09-16T17:03:18.416 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45313.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56934.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50732.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61821.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56625.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45313.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61193.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50732.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37016.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56625.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35847.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61193.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63585.log 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37016.log.gz 2024-09-16T17:03:18.417 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35847.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35847.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62794.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63585.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62794.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62794.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48532.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28508.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66792.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48532.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59751.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28508.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68327.log 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66792.log.gz 2024-09-16T17:03:18.418 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65206.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59751.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68327.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.68327.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55063.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57074.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65206.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53069.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55063.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49462.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57074.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53069.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49462.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-16T17:03:18.419 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65031.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.30861.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46948.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57203.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65031.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31361.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46948.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.57203.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31361.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31361.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64164.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58172.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64164.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64164.log.gz 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52851.log 2024-09-16T17:03:18.420 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28693.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58172.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51448.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50872.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28693.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66528.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51448.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47831.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50872.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66528.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66528.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31221.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67318.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47831.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31263.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31221.log.gz 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42019.log 2024-09-16T17:03:18.421 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67318.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35189.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31263.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42019.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35189.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35189.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43536.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32108.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43536.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43536.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48178.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37911.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32108.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32108.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48178.log.gz 2024-09-16T17:03:18.422 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64584.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37911.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45404.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62143.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28691.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64584.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62143.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62143.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54005.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28691.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63150.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54005.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52133.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58780.log 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63150.log.gz 2024-09-16T17:03:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.52133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60011.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31970.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58780.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60011.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50216.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31970.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42277.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50216.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50216.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz --verbose 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.66100.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38900.log 2024-09-16T17:03:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43627.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66100.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66100.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40236.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57556.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38900.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38900.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39089.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40236.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55708.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57556.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60826.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39089.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55927.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55708.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66277.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60826.log.gz 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38053.log 2024-09-16T17:03:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55927.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55927.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66277.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66277.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60666.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38053.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38053.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60666.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54515.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31481.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59576.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54515.log.gz 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54221.log 2024-09-16T17:03:18.426 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40325.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28550.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59576.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54221.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64303.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28550.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46539.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38570.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65473.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64303.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64303.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38570.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38570.log.gz -5 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60746.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65473.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65473.log.gz 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2024-09-16T17:03:18.427 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60746.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60617.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67697.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68495.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60617.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34624.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67697.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59136.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68495.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59345.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34624.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64982.log 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59136.log.gz 2024-09-16T17:03:18.428 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62234.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59345.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31032.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64982.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56097.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62234.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31032.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31032.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56097.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45962.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz -5 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46668.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61151.log 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2024-09-16T17:03:18.429 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57835.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61151.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61151.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57835.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65116.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46361.log 2024-09-16T17:03:18.430 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65116.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.65116.log.gz /var/log/ceph/ceph-client.admin.67739.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65602.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46361.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46361.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45853.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67739.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65602.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45853.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45853.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38667.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29791.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.38667.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49511.log 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38667.log.gz 2024-09-16T17:03:18.431 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29791.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41614.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49511.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60180.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46459.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41614.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40705.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60180.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39278.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34355.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40705.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58080.log 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39278.log.gz 2024-09-16T17:03:18.432 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67839.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49898.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47611.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58080.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67839.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67839.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47611.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53515.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35081.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37831.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53515.log.gz 2024-09-16T17:03:18.433 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65662.log/var/log/ceph/ceph-client.admin.37831.log: 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37831.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34533.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29096.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63290.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65662.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65662.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56235.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29096.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63290.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40796.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56235.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56235.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40796.log.gz 2024-09-16T17:03:18.434 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51796.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31501.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43256.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51408.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49591.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51796.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51796.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51408.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28872.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49591.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28872.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28872.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66439.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66618.log 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35894.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-09-16T17:03:18.435 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62163.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66439.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66618.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.62163.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31709.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62163.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65339.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37422.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31709.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65339.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65339.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62003.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37422.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35727.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-09-16T17:03:18.436 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58409.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62003.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43855.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50338.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58409.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58409.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33975.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50338.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50338.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39362.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33975.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33975.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64044.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39362.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39362.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57514.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64044.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64044.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57514.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57514.log.gz 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.56983.log 2024-09-16T17:03:18.437 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42550.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56983.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56983.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.62654.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35287.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57731.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62654.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62654.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.45704.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57940.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57731.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45704.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52107.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29012.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57940.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52107.log.gz 2024-09-16T17:03:18.438 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63714.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29012.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63714.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63714.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53766.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34275.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53766.log: -- /var/log/ceph/ceph-client.admin.39928.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53766.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44508.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45271.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28970.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39928.log: gzip -5/var/log/ceph/ceph-client.admin.45271.log: --verbose -- /var/log/ceph/ceph-client.admin.31789.log 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39928.log.gz 2024-09-16T17:03:18.439 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45271.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28970.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28970.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.53029.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31789.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31789.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64813.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.62843.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64813.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64813.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62843.log: gzip -5 --verbose 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62843.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.46201.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38010.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52811.log 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63490.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2024-09-16T17:03:18.440 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52811.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52811.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46857.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28692.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63490.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46857.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.53642.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28692.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28692.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39453.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53642.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.60568.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39453.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39453.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60568.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60568.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.36568.log 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39788.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz 2024-09-16T17:03:18.441 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28004.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58938.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36568.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50118.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28004.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58938.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58938.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68789.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60240.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.50118.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33667.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68789.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60240.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60240.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46997.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33667.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33667.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.53600.log 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46997.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46997.log.gz 2024-09-16T17:03:18.442 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67988.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53600.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.44109.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67988.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67988.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67949.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44109.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.30983.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67949.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.30983.log: --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40445.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68705.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45452.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.62423.log 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-09-16T17:03:18.443 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36155.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68705.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62423.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61015.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36155.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51885.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45833.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61015.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50287.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51885.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47166.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45833.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50287.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50287.log.gz 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40565.log 2024-09-16T17:03:18.444 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47166.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47166.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.48358.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40565.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40565.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64724.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48358.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48358.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64724.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64724.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29381.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52369.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.32477.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29381.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29381.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60924.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32477.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60924.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60924.log.gz 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.42368.log 2024-09-16T17:03:18.445 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30454.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30454.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52195.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42368.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.52065.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67487.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52195.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52065.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52065.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67487.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.57381.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67487.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46102.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz /var/log/ceph/ceph-client.admin.33925.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57381.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29551.log 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-09-16T17:03:18.446 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53473.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.29551.log: /var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67196.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55668.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53473.log: /var/log/ceph/ceph-client.admin.67196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53473.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67196.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55668.log: gzip 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55668.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55619.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42417.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48449.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55619.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55619.log.gz 2024-09-16T17:03:18.447 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59443.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48449.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67529.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46808.log: /var/log/ceph/ceph-client.admin.59443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59443.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67529.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67529.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34882.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40027.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34882.log: gzip -5 --verbose -- 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34882.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.68285.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48138.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59835.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68285.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30542.log 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68285.log.gz 2024-09-16T17:03:18.448 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65731.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59835.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61513.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30542.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46241.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65731.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30093.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65731.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61513.log: /var/log/ceph/ceph-client.admin.46241.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30190.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46241.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61513.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30093.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30093.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56705.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log/var/log/ceph/ceph-client.admin.30190.log: 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30190.log.gz/var/log/ceph/ceph-client.admin.56705.log: 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29874.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56705.log.gz 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62330.log 2024-09-16T17:03:18.449 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51716.log: /var/log/ceph/ceph-client.admin.29874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28592.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29874.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62330.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62330.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28592.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28592.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60359.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47086.log: gzip 48.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28466.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60359.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.41103.log: --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28466.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28466.log.gz 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-09-16T17:03:18.450 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60123.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38102.log: /var/log/ceph/ceph-client.admin.49253.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.60123.log: /var/log/ceph/ceph-client.admin.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47393.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56665.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43305.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56665.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56665.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49720.log 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43305.log.gz 2024-09-16T17:03:18.451 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42059.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36925.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49720.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43494.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0%/var/log/ceph/ceph-client.admin.43934.log: -- replaced with /var/log/ceph/ceph-client.admin.36925.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32735.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43494.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43494.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54263.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44284.log: /var/log/ceph/ceph-client.admin.32735.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32735.log.gz 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53158.log 2024-09-16T17:03:18.452 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54263.log: /var/log/ceph/ceph-client.admin.35798.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54263.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34484.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37722.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53158.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53158.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34484.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34484.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65562.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61709.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37722.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37722.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65562.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65562.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35238.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61709.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61709.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52244.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36974.log 2024-09-16T17:03:18.453 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60875.log 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35238.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35238.log.gz 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36974.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36974.log.gz 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38151.log 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41334.log 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60875.log: /var/log/ceph/ceph-client.admin.38151.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60875.log.gz 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38151.log.gz 2024-09-16T17:03:18.454 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39558.log 2024-09-16T17:03:18.579 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60528.log 2024-09-16T17:03:18.579 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41334.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41334.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39558.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39558.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68579.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56843.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60528.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60528.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68579.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68579.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62374.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40656.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62374.log: /var/log/ceph/ceph-client.admin.56843.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62374.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56843.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40656.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40656.log.gz 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61273.log 2024-09-16T17:03:18.580 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61273.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61273.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31928.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40285.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31928.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31928.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64893.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.40285.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62932.log 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45129.log: /var/log/ceph/ceph-client.admin.64893.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-09-16T17:03:18.581 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64893.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36666.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62932.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49858.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27218.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36666.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36666.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33800.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.27218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57332.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27218.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30903.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33800.log: /var/log/ceph/ceph-client.admin.57332.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33800.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57332.log.gz 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65381.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46011.log 2024-09-16T17:03:18.582 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30903.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54138.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65381.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65381.log.gz/var/log/ceph/ceph-client.admin.46011.log: 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46011.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50523.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68873.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54138.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31081.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68873.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50523.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68873.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50781.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31081.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31081.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50781.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50781.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55748.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50076.log: /var/log/ceph/ceph-client.admin.55748.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2024-09-16T17:03:18.583 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55748.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63634.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35058.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48378.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63634.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63634.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51368.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35058.log: /var/log/ceph/ceph-client.admin.51368.log: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51368.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35058.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68157.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33300.log 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68157.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.68157.log.gz 2024-09-16T17:03:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33300.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50384.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31664.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42858.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50384.log: /var/log/ceph/ceph-client.admin.32775.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50384.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53816.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32775.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42858.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30387.log 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53816.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53816.log.gz 2024-09-16T17:03:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44460.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30387.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30387.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38311.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39886.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47562.log: /var/log/ceph/ceph-client.admin.38311.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38311.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39537.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39886.log: /var/log/ceph/ceph-client.admin.54787.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39886.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55570.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54787.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39537.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54787.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30318.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64184.log 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55570.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55570.log.gz 2024-09-16T17:03:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30318.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30318.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47960.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33478.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64184.log: /var/log/ceph/ceph-client.admin.47960.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64184.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47960.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52642.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28802.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.33478.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48826.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.52642.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30816.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28802.log.gz/var/log/ceph/ceph-client.admin.48826.log: 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48826.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68178.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.30816.log: -- /var/log/ceph/ceph-client.admin.56514.log 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30816.log.gz 2024-09-16T17:03:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58458.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68178.log: 49.6%/var/log/ceph/ceph-client.admin.56514.log: -- replaced with /var/log/ceph/ceph-client.admin.68178.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59305.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61554.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58458.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58458.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59305.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59305.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34057.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38618.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61554.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61554.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34057.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34057.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38231.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38618.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38618.log.gz 2024-09-16T17:03:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38231.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38231.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58829.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34137.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58829.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41712.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35020.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49293.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66663.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41712.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41712.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49293.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49293.log.gz 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30500.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-09-16T17:03:18.589 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66663.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66663.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30500.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30500.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29382.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37702.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40516.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62514.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29382.log: /var/log/ceph/ceph-client.admin.31441.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29382.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62514.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62514.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51090.log: /var/log/ceph/ceph-client.admin.36195.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2024-09-16T17:03:18.590 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64253.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29966.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.64253.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64253.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37192.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29966.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29966.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64124.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37192.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37192.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41243.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64124.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64124.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41243.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41243.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42767.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55241.log 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42139.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-09-16T17:03:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30367.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55241.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55241.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30367.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30367.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55312.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49155.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55490.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55312.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55312.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59971.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55490.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55490.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59971.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59971.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49113.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2024-09-16T17:03:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66969.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45047.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54067.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66969.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66969.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54067.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47653.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53865.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47653.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47653.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34842.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45005.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57989.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34842.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34842.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37960.log 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57989.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57989.log.gz 2024-09-16T17:03:18.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29284.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37960.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37960.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29284.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29284.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39748.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64394.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54047.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39748.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39748.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30143.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54047.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54047.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29222.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30143.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30143.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63843.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29222.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63843.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63843.log.gz 2024-09-16T17:03:18.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61646.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33220.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56340.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61646.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61646.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53686.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56340.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56340.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28694.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53686.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53686.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29699.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28694.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28694.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58738.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29699.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29699.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58738.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58738.log.gz 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63012.log 2024-09-16T17:03:18.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43762.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67127.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63012.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63012.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61905.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67127.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67127.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55126.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61905.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55126.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55126.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54180.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68958.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41833.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58314.log 2024-09-16T17:03:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68958.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68958.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58314.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58314.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47126.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50603.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44191.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32437.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44333.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43585.log 2024-09-16T17:03:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36477.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65969.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43585.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43585.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50563.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65969.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65969.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50563.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50563.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43804.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55003.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40425.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55003.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55003.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66011.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37562.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37582.log 2024-09-16T17:03:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66011.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66011.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37582.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37582.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28415.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34931.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50823.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28415.log: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.28415.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63190.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50823.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50823.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44956.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63190.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63190.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62972.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44956.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44956.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62972.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62972.log.gz 2024-09-16T17:03:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33122.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42228.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67276.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33122.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29521.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67276.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67276.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48582.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29521.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29521.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34097.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48582.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48582.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66319.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34097.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34097.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41572.log 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66319.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66319.log.gz 2024-09-16T17:03:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65920.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41572.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41572.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65920.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65920.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59526.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53298.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59526.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59526.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57401.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59485.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49413.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68663.log 2024-09-16T17:03:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59485.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59485.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68663.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68663.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33042.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47304.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40187.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33042.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58640.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40187.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40187.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58640.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58640.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30276.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64853.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67236.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30276.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30276.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32019.log 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67236.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67236.log.gz 2024-09-16T17:03:18.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32019.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32019.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63536.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51577.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38994.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63536.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63536.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38994.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38994.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51676.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44415.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40894.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58030.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44415.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44415.log.gz 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2024-09-16T17:03:18.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58030.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58030.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59265.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37324.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32655.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59265.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59265.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45655.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32655.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32655.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45655.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45655.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43975.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66577.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53431.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-09-16T17:03:18.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66577.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66577.log.gz 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37266.log 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58549.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.37266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62752.log 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45180.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30633.log 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-09-16T17:03:18.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62752.log.gz 2024-09-16T17:03:18.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63892.log 2024-09-16T17:03:18.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30633.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30633.log.gz 2024-09-16T17:03:18.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-09-16T17:03:18.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63892.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63892.log.gz 2024-09-16T17:03:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45916.log 2024-09-16T17:03:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48009.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-09-16T17:03:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2024-09-16T17:03:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45916.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45916.log.gz 2024-09-16T17:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59793.log 2024-09-16T17:03:18.643 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46152.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2024-09-16T17:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-09-16T17:03:18.652 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59793.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59793.log.gz 2024-09-16T17:03:18.661 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49551.log 2024-09-16T17:03:18.662 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45575.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-09-16T17:03:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31123.log 2024-09-16T17:03:18.680 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49551.log.gz 2024-09-16T17:03:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65642.log 2024-09-16T17:03:18.689 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31123.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31123.log.gz 2024-09-16T17:03:18.710 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2024-09-16T17:03:18.710 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65642.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65642.log.gz 2024-09-16T17:03:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30673.log 2024-09-16T17:03:18.719 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55828.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2024-09-16T17:03:18.735 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60062.log 2024-09-16T17:03:18.735 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30673.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30673.log.gz 2024-09-16T17:03:18.744 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64348.log 2024-09-16T17:03:18.744 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60062.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60062.log.gz 2024-09-16T17:03:18.763 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60488.log 2024-09-16T17:03:18.763 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64348.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64348.log.gz 2024-09-16T17:03:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68537.log 2024-09-16T17:03:18.772 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60488.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60488.log.gz 2024-09-16T17:03:18.792 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29138.log 2024-09-16T17:03:18.792 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68537.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68537.log.gz 2024-09-16T17:03:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28083.log 2024-09-16T17:03:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29138.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29138.log.gz 2024-09-16T17:03:18.810 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32864.log 2024-09-16T17:03:18.810 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28083.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28083.log.gz 2024-09-16T17:03:18.819 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58918.log 2024-09-16T17:03:18.819 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32864.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32864.log.gz 2024-09-16T17:03:18.837 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33842.log 2024-09-16T17:03:18.837 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58918.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58918.log.gz 2024-09-16T17:03:18.846 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-09-16T17:03:18.846 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33842.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33842.log.gz 2024-09-16T17:03:18.860 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52593.log 2024-09-16T17:03:18.860 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36746.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-09-16T17:03:18.878 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68747.log 2024-09-16T17:03:18.878 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52593.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52593.log.gz 2024-09-16T17:03:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2024-09-16T17:03:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68747.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68747.log.gz 2024-09-16T17:03:18.900 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50256.log 2024-09-16T17:03:18.900 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42725.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-09-16T17:03:18.912 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2024-09-16T17:03:18.912 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50256.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50256.log.gz 2024-09-16T17:03:18.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2024-09-16T17:03:18.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47911.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2024-09-16T17:03:18.941 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50167.log 2024-09-16T17:03:18.941 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38191.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gz 2024-09-16T17:03:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29918.log 2024-09-16T17:03:18.950 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50167.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50167.log.gz 2024-09-16T17:03:18.967 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31312.log 2024-09-16T17:03:18.967 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29918.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29918.log.gz 2024-09-16T17:03:18.978 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61094.log 2024-09-16T17:03:18.978 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31312.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31312.log.gz 2024-09-16T17:03:18.992 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37513.log 2024-09-16T17:03:18.992 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61094.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61094.log.gz 2024-09-16T17:03:19.001 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-09-16T17:03:19.001 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37513.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37513.log.gz 2024-09-16T17:03:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-09-16T17:03:19.018 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36288.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-09-16T17:03:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T17:03:19.031 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45753.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-09-16T17:03:19.047 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35469.log 2024-09-16T17:03:19.049 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T17:03:19.060 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57576.log 2024-09-16T17:03:19.061 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35469.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35469.log.gz 2024-09-16T17:03:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29054.log 2024-09-16T17:03:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57576.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.57576.log.gz 2024-09-16T17:03:19.079 INFO:teuthology.orchestra.run.smithi103.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.52133.log.gz 2024-09-16T17:03:19.081 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41970.log 2024-09-16T17:03:19.081 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29054.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29054.log.gz 2024-09-16T17:03:19.081 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-09-16T17:03:19.081 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41970.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41970.log.gz 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64675.log 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34226.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64675.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64675.log.gz 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68621.log 2024-09-16T17:03:19.084 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-09-16T17:03:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34980.log 2024-09-16T17:03:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68621.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68621.log.gz 2024-09-16T17:03:19.086 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2024-09-16T17:03:19.087 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34980.log: 48.8% -- replaced with /var/log/ceph/ceph-client.admin.34980.log.gz 2024-09-16T17:03:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68156.log 2024-09-16T17:03:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41432.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2024-09-16T17:03:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59855.log 2024-09-16T17:03:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68156.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68156.log.gz 2024-09-16T17:03:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose 92.9% -- replaced with /var/log/ceph/ceph-client.0.43855.log.gz 2024-09-16T17:03:19.090 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.55988.log 2024-09-16T17:03:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67018.log 2024-09-16T17:03:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59855.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59855.log.gz 2024-09-16T17:03:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55988.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.51270.log 2024-09-16T17:03:19.091 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55988.log.gz 2024-09-16T17:03:19.109 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54921.log 2024-09-16T17:03:19.109 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51270.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67018.log.gz 2024-09-16T17:03:19.109 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51270.log.gz 2024-09-16T17:03:19.109 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53227.log 2024-09-16T17:03:19.109 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54921.log: /var/log/ceph/ceph-client.admin.31401.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54921.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65424.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6%/var/log/ceph/ceph-client.admin.31401.log: -- replaced with /var/log/ceph/ceph-client.admin.53227.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31401.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.65424.log: /var/log/ceph/ceph-client.admin.54435.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65424.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33498.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54435.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54435.log.gz 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63101.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.33498.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36071.log 2024-09-16T17:03:19.110 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33498.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40754.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63101.log: /var/log/ceph/ceph-client.admin.36071.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63101.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36071.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58220.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68117.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40754.log: /var/log/ceph/ceph-client.admin.58220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40754.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58220.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60706.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54963.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68117.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68117.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60706.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60706.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52900.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52900.log: /var/log/ceph/ceph-client.admin.54963.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54963.log.gz 2024-09-16T17:03:19.111 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52900.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63396.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67838.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42592.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63396.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63396.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50941.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55172.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50941.log: /var/log/ceph/ceph-client.admin.67838.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67838.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50941.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68453.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.55172.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62612.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55172.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29479.log 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62612.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68453.log.gz 2024-09-16T17:03:19.112 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62612.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33171.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.29479.log: -- /var/log/ceph/ceph-client.admin.65071.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29479.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65071.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33171.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65071.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34315.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53956.log: -- /var/log/ceph/ceph-client.admin.40376.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34315.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35707.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34315.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40376.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40376.log.gz 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62703.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log 2024-09-16T17:03:19.113 INFO:teuthology.orchestra.run.smithi103.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.35707.log.gz 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42949.log 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53360.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62703.log.gz 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35147.log 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51002.log 2024-09-16T17:03:19.114 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42949.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42949.log.gz 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35147.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49818.log 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35147.log.gz 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38856.log 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51002.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51002.log.gz 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49818.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49818.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2024-09-16T17:03:19.218 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65164.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38856.log: /var/log/ceph/ceph-client.admin.51319.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38856.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34802.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.65164.log: -- /var/log/ceph/ceph-client.admin.30591.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65164.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46281.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30591.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34802.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30591.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46281.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46281.log.gz 2024-09-16T17:03:19.219 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45793.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28326.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68998.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28326.log: /var/log/ceph/ceph-client.admin.47433.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28326.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56745.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68998.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68998.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56745.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56745.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35658.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32348.log: /var/log/ceph/ceph-client.admin.35658.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35658.log.gz 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42179.log 2024-09-16T17:03:19.220 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39229.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61415.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49015.log: /var/log/ceph/ceph-client.admin.42179.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42179.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32068.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32159.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61415.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61415.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32068.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32068.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32397.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33082.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32397.log: /var/log/ceph/ceph-client.admin.32159.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32159.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32397.log.gz 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2024-09-16T17:03:19.221 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33082.log: /var/log/ceph/ceph-client.admin.31829.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33082.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31172.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56277.log: /var/log/ceph/ceph-client.admin.31829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31829.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31172.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36337.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42633.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.31570.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36827.log 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48746.log: /var/log/ceph/ceph-client.admin.31570.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31570.log.gz 2024-09-16T17:03:19.222 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47473.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36827.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36827.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47473.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47473.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56186.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47751.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36246.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30774.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68019.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30774.log: /var/log/ceph/ceph-client.admin.56186.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56186.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30774.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55450.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52284.log 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68019.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68019.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55450.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55450.log.gz 2024-09-16T17:03:19.223 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59001.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59001.log: /var/log/ceph/ceph-client.admin.52284.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52284.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59001.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61064.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41879.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44865.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61064.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61064.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50643.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64084.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50643.log: /var/log/ceph/ceph-client.admin.41879.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41879.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50643.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64084.log.gz 2024-09-16T17:03:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34375.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55530.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45089.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59185.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63445.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55530.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0%/var/log/ceph/ceph-client.admin.63445.log: -- replaced with /var/log/ceph/ceph-client.admin.59185.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63445.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30725.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46906.log: /var/log/ceph/ceph-client.admin.41054.log 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-09-16T17:03:19.225 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35518.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41054.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30725.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28240.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35518.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35518.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28240.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28240.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59225.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48875.log: /var/log/ceph/ceph-client.admin.59225.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59225.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35378.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59394.log 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66710.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6%/var/log/ceph/ceph-client.admin.59394.log: -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59394.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66710.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66710.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54395.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60786.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64933.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56452.log: /var/log/ceph/ceph-client.admin.60786.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60786.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41474.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52989.log 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64933.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64933.log.gz 2024-09-16T17:03:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41474.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57025.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41474.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.60123.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.52989.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58360.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52989.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57025.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60406.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57025.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59618.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58360.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51929.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60406.log: /var/log/ceph/ceph-client.admin.59618.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60406.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38409.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59618.log.gz 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51929.log: -- /var/log/ceph/ceph-client.admin.34722.log 2024-09-16T17:03:19.228 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51929.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38409.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38409.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34722.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34722.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35938.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67841.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35329.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59926.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67841.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67841.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64633.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59926.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49333.log 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59926.log.gz 2024-09-16T17:03:19.229 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64633.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64633.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62472.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49333.log: gzip 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49333.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37871.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62472.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62472.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63995.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.37871.log: --verbose -- /var/log/ceph/ceph-client.admin.62043.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37871.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63995.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63995.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40934.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62043.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40934.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40934.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48666.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-09-16T17:03:19.230 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32557.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.44781.log: --verbose -- /var/log/ceph/ceph-client.admin.29739.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32557.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32557.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48491.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38360.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29739.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48491.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57892.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38360.log: gzip -5 --verbose 50.0% -- /var/log/ceph/ceph-client.admin.54654.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38360.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57892.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.30050.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57892.log.gz 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65871.log 2024-09-16T17:03:19.231 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54654.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30050.log: /var/log/ceph/ceph-client.admin.65871.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30050.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49938.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65871.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63794.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47871.log: /var/log/ceph/ceph-client.admin.49938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54313.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49938.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63794.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63794.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29608.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54313.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54313.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29608.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29608.log.gz 2024-09-16T17:03:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37786.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66359.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58878.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37786.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37786.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58878.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58878.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61604.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39382.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38489.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61604.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61604.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38489.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38489.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50474.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-09-16T17:03:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32913.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39495.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36876.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39495.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39495.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44823.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30008.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45355.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58129.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30008.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30008.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33569.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67087.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58129.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33569.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33569.log.gz 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2024-09-16T17:03:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67087.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67087.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39040.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.41014.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51488.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39040.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66885.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.51488.log: --verbose -- /var/log/ceph/ceph-client.admin.56137.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51488.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66885.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28268.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66885.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62094.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56137.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61863.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.28268.log: /var/log/ceph/ceph-client.admin.62094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31749.log 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28268.log.gz 2024-09-16T17:03:19.235 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62094.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61863.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61863.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30234.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31749.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31749.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66927.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30234.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30234.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60310.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36113.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66927.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60310.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60310.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57163.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36113.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36113.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57163.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57163.log.gz 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-16T17:03:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.49064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59709.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68411.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59709.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59709.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68411.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58269.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56885.log/var/log/ceph/ceph-client.admin.37373.log: 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6%/var/log/ceph/ceph-client.admin.58269.log: -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58269.log.gz 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39622.log 2024-09-16T17:03:19.237 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56885.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56885.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29833.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39622.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.29833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48706.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29833.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60448.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40147.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62892.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48706.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48706.log.gz 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53726.log 2024-09-16T17:03:19.238 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60448.log: /var/log/ceph/ceph-client.admin.62892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58598.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60448.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62892.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53726.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53726.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39320.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58598.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34580.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 49.6% 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39320.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62563.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52551.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59047.log 2024-09-16T17:03:19.239 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62563.log: /var/log/ceph/ceph-client.admin.37152.log: 50.0%gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66399.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59047.log: -- replaced with /var/log/ceph/ceph-client.admin.62563.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59047.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.66399.log: --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66399.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38271.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68369.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53340.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67613.log 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68369.log.gz 2024-09-16T17:03:19.240 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60102.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53340.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53340.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.67613.log: /var/log/ceph/ceph-client.admin.46624.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67613.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60102.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.60102.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66186.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56318.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46624.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66186.log: /var/log/ceph/ceph-client.admin.35980.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66186.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56318.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56318.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37462.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35980.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42099.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37462.log: gzip -5 --verbose 50.0% -- /var/log/ceph/ceph-client.admin.37107.log 2024-09-16T17:03:19.241 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37462.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42099.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65297.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37107.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59659.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48316.log: /var/log/ceph/ceph-client.admin.65297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65297.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.59659.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66752.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59659.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52731.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-09-16T17:03:19.242 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66752.log: /var/log/ceph/ceph-client.admin.52731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67571.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52731.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36428.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66752.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60220.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65829.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67571.log: 50.0%/var/log/ceph/ceph-client.admin.60220.log: -- replaced with /var/log/ceph/ceph-client.admin.67571.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63754.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60220.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55788.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.65829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65829.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33883.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.63754.log: /var/log/ceph/ceph-client.admin.55788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63754.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55788.log.gz 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41921.log 2024-09-16T17:03:19.243 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33883.log: /var/log/ceph/ceph-client.admin.47349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57689.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33883.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41921.log: /var/log/ceph/ceph-client.admin.57689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34762.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41921.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57689.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47791.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46559.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34762.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34762.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66479.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46559.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46559.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56585.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.66479.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66479.log.gz 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41194.log 2024-09-16T17:03:19.244 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56585.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56585.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61954.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41194.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41194.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54704.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61954.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61954.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54704.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54704.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55404.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67840.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.56494.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46321.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67840.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67840.log.gz 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55043.log 2024-09-16T17:03:19.245 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46321.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46321.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54613.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55043.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36617.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54808.log: /var/log/ceph/ceph-client.admin.54613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54613.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36617.log: -- /var/log/ceph/ceph-client.admin.33618.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36617.log.gz/var/log/ceph/ceph-client.admin.43721.log: 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55878.log 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38809.log/var/log/ceph/ceph-client.admin.33618.log: 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55878.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55878.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38809.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38809.log.gz 2024-09-16T17:03:19.246 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T17:03:19.261 INFO:teuthology.orchestra.run.smithi103.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.29551.log.gz 2024-09-16T17:03:19.289 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.37266.log.gz 2024-09-16T17:03:25.901 INFO:teuthology.orchestra.run.smithi142.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T17:03:26.036 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T17:03:26.288 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T17:03:26.290 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-16T17:03:26.290 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m8.049s 2024-09-16T17:03:26.290 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m19.891s 2024-09-16T17:03:26.290 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.258s 2024-09-16T17:03:26.507 INFO:teuthology.orchestra.run.smithi142.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T17:03:26.510 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-16T17:03:26.510 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m8.225s 2024-09-16T17:03:26.510 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m15.270s 2024-09-16T17:03:26.510 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.623s 2024-09-16T17:03:26.510 INFO:tasks.ceph:Archiving logs... 2024-09-16T17:03:26.510 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi103/log 2024-09-16T17:03:26.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:03:29.668 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi142/log 2024-09-16T17:03:29.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:03:31.641 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T17:03:31.650 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T17:03:31.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:03:31.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:03:31.724 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T17:03:31.732 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T17:03:31.733 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:03:31.736 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:03:31.750 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:03:31.752 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -317us[ -322us] +/- 38ms 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -22us[ -27us] +/- 71ms 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +531us[ +526us] +/- 60ms 2024-09-16T17:03:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 -311us[ -308us] +/- 38ms 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -23us[ -23us] +/- 71ms 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +531us[ +531us] +/- 60ms 2024-09-16T17:03:31.757 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:03:31.758 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T17:03:31.789 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T17:03:31.789 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T17:03:31.798 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:03:31.881 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:03:31.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:03:31.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:03:31.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:03:32.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:03:32.009 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T17:03:32.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T17:03:32.027 INFO:teuthology.task.internal:Duration was 1622.424564 seconds 2024-09-16T17:03:32.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T17:03:32.036 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T17:03:32.036 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:03:32.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:03:32.076 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:03:32.090 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:03:32.394 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T17:03:32.395 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-16T17:03:32.395 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:03:32.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-16T17:03:32.456 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:03:32.484 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T17:03:32.484 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:03:32.498 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:03:32.553 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T17:03:32.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:03:32.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:03:32.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T17:03:32.708 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T17:03:32.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:03:32.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:03:32.758 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T17:03:32.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:03:32.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:03:32.796 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-16T17:03:32.821 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-16T17:03:32.873 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:03:32.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:03:32.888 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:03:32.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:03:32.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T17:03:32.938 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T17:03:32.938 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi103 2024-09-16T17:03:32.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:03:32.973 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907370/remote/smithi142 2024-09-16T17:03:32.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:03:33.005 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T17:03:33.005 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:03:33.010 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:03:33.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T17:03:33.066 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T17:03:33.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T17:03:33.076 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T17:03:33.076 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:03:33.080 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:03:33.091 INFO:teuthology.orchestra.run.smithi103.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:03 /home/ubuntu/cephtest 2024-09-16T17:03:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:03 /home/ubuntu/cephtest 2024-09-16T17:03:33.112 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T17:03:33.122 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T17:03:33.142 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench} duration: 1622.4245643615723 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T17:03:33.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T17:03:33.228 INFO:teuthology.run:pass